Tool picks2024-01-09 · Archive
I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
Original EnglishWhere this applies — and where it may not
Original English evidence, selected for practical experience and outcomes. Read the source discussion for context.
From the discussion
“BTW, I used development tools in the browser to measure latency for the free ChatGPT 3.5, and got about 900 milliseconds till the first token.”
@Const-me · View source
Y
I made an app that runs Mistral 7B 0.2 LLM locally on iPhone Pros
@Const-me · 292 points · 188 comments
Read the Hacker News threadSource: OpenIndex Hacker News dataset (ODC-By). Original content belongs to its authors. Summaries, translations, and suggested steps are AI-assisted editorial work. Read the sources; individual outcomes are not guarantees.