Blog
Articles and updates from Symas, Marty, and Howard.
Mastodon links open in a new tab. RSS includes Symas articles only.
Building Reliable AI with Deterministic Algorithms and Guardrails Most AI food-ordering chatbots hallucinate prices, invent unavailable pizza sizes, and claim orders are placed without verifying the database. The challenge was to build an AI waiter that handles complex orders while maintaining accu…
View on Mastodon (opens in a new tab)WineFS: A Hugepage-aware File System for Persistent Memory that Ages Gracefully Modern persistent-memory (PM) file systems perform well in benchmarks, when the FS is fresh. But after being aged by usage, their performance degrades significantly. We introduce WineFS, a novel hugepage-aware PM file s…
View on Mastodon (opens in a new tab)Principles and Practices of Transaction Recovery in Distributed Databases This article discusses the specific challenges of transaction recovery in both standalone and distributed databases, explores typical solutions to these challenges, and provides practices of transaction recovery in OceanBase …
View on Mastodon (opens in a new tab)Glean 0.2.0.0 has a new experimental DB backend based on LMDB. #LMDB is much smaller and simpler than RocksDB, and in most of our benchmarks it performed around 30-40% better https://glean.software/blog/release-0-2/
View on Mastodon (opens in a new tab)Optimizing Management of Persistent Data Structures in High-Performance Analytics we present Privateer, a memory and storage management tool that enables storage-efficient virtual memory snapshotting while also optimizing snapshot I/O performance. We integrated Privateer into Metall, a state-of-the…
View on Mastodon (opens in a new tab)RE: https://indieweb.social/@jbz/117469115039538448 Many employees work for bad employers.
View on Mastodon (opens in a new tab)RE: https://toot.cat/@yudderick/117463748760893826 I must somehow use this in a future talk about how #LMDB B+trees work.
View on Mastodon (opens in a new tab)Serialization considered boring Open a 34 MB value in a konserve store and increment one counter inside it: The call writes one page and returns. The rest of the value is never decoded, never rebuilt as objects, never re-encoded and never rewritten. The ordinary update-in reads the whole value, rec…
View on Mastodon (opens in a new tab)If you're using #LMDB and growing the mapsize dynamically when you get the MAP_FULL error, You're Doing It Wrong. If you're doing this *and* you've set a cap on how large you're willing to resize it to, You're Really Doing It Wrong. Just set the mapsize to your hard cap limit at the beginning, and …
View on Mastodon (opens in a new tab)