Recent content by m1tr

  1. m1tr

    WTB Lenovo Pen Plus Stylus

    Interested in buying Lenovo Pen Plus stylus (AP500u). It is also sold bundled with the Lenovo P12 tablets. I'm located in Bangalore.
  2. m1tr

    Android Small / Mini Tablets?

    Hey this looks nice, thanks. I think Android 14 comes with a built-in taskbar but Lenovo's implementation is pretty barebones. I'll try this one out. Lenovo Pen Plus (I think it's called) is officially supported according to the reviews I've watched. I have seen Pen support within the settings...
  3. m1tr

    Android Small / Mini Tablets?

    Bought the Legion Tab from Flipkart for 27k before bank offers. Overall it's a great device for the price and should last me a good while. Quick review: Great, high res screen Metal build, lightweight but feels sturdy Good 45W charger and cable in the box Great performance, apps install...
  4. m1tr

    WTB Battery and NIC for Dell Vostro 5415

    I'd like to upgrade my 2021 Dell Vostro 5415 (AMD) laptop. Parts needed: Battery : Dell V6W33 4 cell 54Wh Wifi: Intel AX210 Preferred sellers in Bangalore for F2F deal
  5. m1tr

    How to launch a big cloud VM with GPUs to run AI workloads?

    Has anyone else tried Jarvis Labs? It's a Coimbatore based company and the instances are quite cheap IMO (although I haven't really compared the rates to other CSPs).
  6. m1tr

    90K+ Best country to Import Macbook pro & how ?

    Did you import it or were you able to source it locally? Please share the price as well.
  7. m1tr

    How to launch a big cloud VM with GPUs to run AI workloads?

    8B model with 5GB memory sounds like a pretty heavy quantisation. Do check the perplexity numbers to see how much you're losing in model quality.
  8. m1tr

    How to launch a big cloud VM with GPUs to run AI workloads?

    Check out sqlcoder by defog. It's available on huggingface. They fine-tune llama for text to SQL. We benchmarked the codellama finetune and found the performance on par with GPT4 (with extensive pre and post processing). They have a newer finetune based on llama3 which is supposed to be even better.
  9. m1tr

    How to launch a big cloud VM with GPUs to run AI workloads?

    Any particular reason you're not using the smaller variants? They are surprisingly good. Alternatively, you might look into quantizing the models to Q5_K_M in llama.cpp for minimal loss in quality.
  10. m1tr

    Android Small / Mini Tablets?

    Looks like the "Legion Tab" has made its way to the Lenovo website here. Priced at 35k and looks like they will start shipping at the end of August.
  11. m1tr

    Android Small / Mini Tablets?

    I usually see a couple of Indian reviews just to get a feel of the product as it's launched. But yea 40k for a 2 year old CPU won't cut it. Especially with no bundled accessories.
  12. m1tr

    Android Small / Mini Tablets?

    No news or reviews of this product after its "launch". Also, the price has gone up to 40k within days. Something doesn't sit right. I was really looking forward to buying this :disrelieved:
  13. m1tr

    Is car ceramic coating worth it and which one is preferred

    PPF is only for exotics where getting something repainted is a big deal. For most normal cars owned and driven by normal people, PPF is not required at all. Get your car detailed every 12/18 months instead.
  14. m1tr

    LLM's usefulness

    We were already AWS customers, so when the LLM hype hit even the non-data science folks started experimenting with LLMs on big GPU instances. Again, playing with LLMs is always fun but getting it reliable enough for business applications is a different thing entirely.
  15. m1tr

    LLM's usefulness

    Take it from someone in the industry: LLMs and "generalist AI" is all hype. My company paid through the nose last year for AWS and absolutely nothing came out of it. People are hyping it up like crazy simply because for the first time AI has reached the point where laypeople can "use" it. The...