Meetups/Infra/2024-01-08

Today we had a wide-ranging discussion, and notes are links to related content: blog posts & searches; covering topics addressed.

Introductions

• Loren - running meetup, last 6 mo. Here to stay sharp, keep others sharp.
• Doug - run's own infra for work, data analytics company
• Jordan - past nix enthusiast, database software engineer
• Quinn - noisebridger, interested in learning all the things
• Brandon - noisebridge contributor to lock projects, software engineer in the daytime
• Brennan - barista by day, software engineer by night

Lesson or Demo

Links from today's discussions. For further reading.

• • https://search.brave.com/search?q=cloudflare+valuation&source=desktop&rh_type=st&range=ytd | cloudflare valuation - Brave Search
  • https://search.brave.com/search?q=song+a+man+in+the+middle&source=desktop | song a man in the middle - Brave Search
  • https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=wiki%20static%20sqlite&sort=byPopularity&type=all | All | Search powered by Algolia
  • http://static.wiki/enwikiquote/
  • https://news.ycombinator.com/item?id=28012829 | Show HN: Static.wiki – read-only Wikipedia using a 43GB SQLite file | Hacker News
• • https://search.brave.com/search?q=file+system+seekable&source=desktop | file system seekable - Brave Search
  • https://wicg.github.io/file-system-access/ | File System Access
  • https://www.man7.org/linux/man-pages/man2/lseek.2.html | lseek(2) - Linux manual page
• • https://hn.algolia.com/?dateRange=pastMonth&page=0&prefix=true&query=aws%20s3%20pipe&sort=byPopularity&type=all | All | Search powered by Algolia
  • https://github.com/s3m | s3m
  • https://spdk.io/ | Storage Performance Development Kit
  • https://search.brave.com/search?q=spkd+vs+io_uring&source=desktop | spkd vs io_uring - Brave Search
  • https://atlarge-research.com/pdfs/2022-systor-apis.pdf | Understanding Modern Storage APIs: A systematic study of libaio, SPDK, and io_uring
  • https://unix.stackexchange.com/questions/728807/what-is-the-impact-of-different-linux-i-o-apis-on-performance-benchmarking-of-nv | io - What is the impact of different Linux I/O APIs on performance benchmarking of NVMe SSDs? (libaio vs SPDK vs io_uring) - Unix & Linux Stack Exchange
  • https://github.com/s3m/s3m | s3m/s3m: CLI for streams of data in S3 buckets
  • https://search.brave.com/search?q=ssd+zoned+namespaces&source=desktop | ssd zoned namespaces - Brave Search
  • https://www.snia.org/educational-library/zoned-namespaces-zns-ssds-disrupting-storage-industry-2020 | Zoned Namespaces (ZNS) SSDs: Disrupting the Storage Industry | SNIA
• • https://search.brave.com/search?q=dpdk&source=desktop | dpdk - Brave Search
  • https://github.com/DPDK/dpdk | DPDK/dpdk: Data Plane Development Kit
• • https://hn.algolia.com/?dateRange=all&page=0&prefix=true&query=netflix+dpdk&sort=byPopularity&type=all | All | Search powered by Algolia
  • https://news.ycombinator.com/item?id=33205190 | Netflix interestingly (rather than focusing on DPDK/user-space techniques) seems... | Hacker News
  • https://news.ycombinator.com/item?id=33200171#33205190 | Some remotely exploitable Linux kernel WiFi vulnerabilities | Hacker News
  • https://netflixtechblog.com/serving-100-gbps-from-an-open-connect-appliance-cdb51dda3b99 | Serving 100 Gbps from an Open Connect Appliance | by Netflix Technology Blog | Netflix TechBlog
  • https://news.ycombinator.com/item?id=14017993 | Turtles on the Wire: Understanding How the OS Uses the Modern NIC (2016) | Hacker News
  • https://news.ycombinator.com/item?id=14021254 | See drewg's comment. He is being modest in that they are also doing CPU encrypti... | Hacker News
• • https://search.brave.com/search?q=rdma+enabled+network+adapter&source=desktop | rdma enabled network adapter - Brave Search
  • https://search.brave.com/search?q=setting+up+rdma&source=desktop | setting up rdma - Brave Search
  • https://support.mellanox.com/s/knowledge-center | Knowledge center
  • https://search.brave.com/search?q=lwn+peer+to+peer+dma&source=desktop | lwn peer to peer dma - Brave Search
  • https://lwn.net/Articles/931668/ | Peer-to-peer DMA [LWN.net]
• • https://search.brave.com/search?q=latency+programmers+every+should+know&source=desktop | latency programmers every should know - Brave Search
  • https://colin-scott.github.io/personal_website/research/interactive_latency.html | Numbers Every Programmer Should Know By Year
  • https://medium.com/@hondanhon/more-latency-numbers-every-programmer-should-know-3142f0cf614d | (More) Latency Numbers Every Programmer Should Know | by Dan Hon | Medium
  • https://softwareengineering.stackexchange.com/questions/312485/how-can-jeff-deans-latency-numbers-every-programmer-should-know-be-accurate-i | How can Jeff Dean's "latency numbers every programmer should know" be accurate in the context of varying hardware implementations? - Software Engineering Stack Exchange
  • https://news.ycombinator.com/item?id=17908403 | Latency Numbers Every Programmer Should Know | Hacker News
  • https://pesin.space/posts/2020-09-22-latencies/ | Ivan Pesin | Latency numbers every engineer should know
• • https://search.brave.com/search?q=china+ml+memory+usage+models&source=desktop | china ml memory usage models - Brave Search
• • https://search.brave.com/search?q=moores+law&source=desktop | moores law - Brave Search
  • https://search.brave.com/search?q=dennard+scaling&source=desktop | dennard scaling - Brave Search
  • https://en.wikipedia.org/wiki/Dennard_scaling | Dennard scaling - Wikipedia
  • https://wgropp.cs.illinois.edu/courses/cs598-s15/lectures/lecture15.pdf | lecture15.pptx
  • https://search.brave.com/search?q=cs61c+end+of+dennard+scaling+moores+law+berkeley&source=web | cs61c end of dennard scaling moores law berkeley - Brave Search
• • https://search.brave.com/search?q=m2+hbm&source=desktop | m2 hbm - Brave Search
  • https://news.ycombinator.com/item?id=28996584 | It partially is. The M1 max comes with integrated hbm, which is way higher bandw... | Hacker News
  • https://news.ycombinator.com/item?id=28994800&p=2#28996584 | Rendering on the Apple M1 Max Chip | Hacker News
  • https://search.brave.com/search?q=LPDDR5&source=desktop | LPDDR5 - Brave Search
  • https://semiconductor.samsung.com/us/dram/lpddr/lpddr5/ | LPDDR5 | DRAM | Samsung Semiconductor USA
  • https://www.anandtech.com/print/17024/apple-m1-max-performance-review | Apple's M1 Pro, M1 Max SoCs Investigated: New Performance and Efficiency Heights - Print View

For next time

I'll be away for the next few weeks. You're welcome to meet up anyway!

Join online

• [Discord] #meetup-infra