Meetups/Infra/2025-01-27

https://www.noisebridge.net/wiki/Meetups/Infra/2025-01-13#Takeway_requests https://meet.jit.si/nb-meetup-infra

(Preamble:

   = Meetup - Infra =
   https://www.noisebridge.net/wiki/Meetups/Infra
   https://www.noisebridge.net/wiki/Meetups/Infra/2024-..-.. )

2025-01-27m Meetups/Infra

(TODO summary)

Introductions

• [name] - [background]. [goals for meetup, or interests to explore]
• Loren --

welcome to ML/LLM themed night of the infra meetup. Tonight, I want us building ourselves workflows with llm tools. A particular workflow -- something for hosting meetings in person. Sharing links, chat, record/ transcript locally.

• Doug -- today, actively building out workflows for computer vision
• Wolf -- using an LLM to rewrite my resume this week. (curious about motiviation & success
• Greg -- nix. interested in running generative AIs locally
• Kevin -- on his way to nb :) :) -- experimenting with fine-tuning & rag. Have a vector store, spidering. Using clickhouse, sqlite query interface -- lots of magic baked in. Common crawl

• Sameer -- currently ambivalent about software.
• Jams -- downloading ollama now. Looking forward to asking questions I wouldn't ask only,
• Mike -- Software engineer. I like to watch.

Lesson or Demo

• Read aloud: clarify for meetup. We are taking notes in a riseup pad (or I am--help appreciated, and links). We have meeting notes posted to the wiki. noisebridge.net, search Infra, or Meetups/Infra. (the Infrastructure page has a disambiguation link.)
• Shell, web services, self-hosting, networking!

• BlueSky -- 2024 -- self-hosted possible route
  • https://docs.bsky.app/blog/self-host-federation
  • doubt from the mastodon sphere.

= Doug -- image recognition

difficult task. Identify text from ads & flyers, alongside images. https://github.com/VikParuchuri/surya

tesseract -- likes a column, line, word, whole page -- but

structured outputs with multimodel inputs, it's amazing.

DeepSeek papers

• "[DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://ar5iv.labs.arxiv.org/html/2402.03300)"
• https://x.com/robinhanson/status/977261256443822080
• [MATH Benchmark](https://klu.ai/glossary/math-eval)
• https://arxiv.org/html/2412.19437v1 -- DeepSeek technical report

Takeaways

• Doug -- downloading surya, thanks Sameer!
  • Kevin & Jams -- vision & text. llama vision.

• Greg -- has ollama and llm installed now, pulling, playing

https://simonwillison.net/2025/Jan/20/deepseek-r1/

• Kevin -- more complete version of common crawl vector store for RAG-backed app

Questions, Discussion, or Coworking

• [Issue]

For next time

Readings & Exercises

• Readings
• Exercises

1. 1. Installing llm using the Python uv tool

After having installed the `uv` tool run `uv tool install llm`

Then you can run it with `uv tool run llm *args`

Join online

• Try it yourself!
  • Join libera.chat #nb-meetup-infra

https://www.noisebridge.net/wiki/Meetups/Infra