Leela Kumili writes that Cursor has introduced Continuity, a novel Git storage architecture designed for massive scale by utilizing an Amazon S3-backed write-ahead log (WAL) as the primary source of truth. By moving the consistency boundary from individual replica coordination to durable object storage, Cursor can support high throughput and large numbers of replicas, achieving over 300 pushes per second when using S3 Express One Zone. This architecture specifically addresses the needs of massive monorepos used in CI workloads and the surge in small repositories generated by autonomous coding agents.
- Local NVMe repositories function as warm caches rather than authoritative copies.
- Rendezvous hashing is utilized to select preferred nodes for data access.
- UDP gossip protocols propagate WAL updates across the system.
- High performance is achieved via batching operations to mitigate S3 PUT latency.
- Local NVMe repositories function as warm caches rather than authoritative copies.
- Rendezvous hashing is utilized to select preferred nodes for data access.
- UDP gossip protocols propagate WAL updates across the system.
- High performance is achieved via batching operations to mitigate S3 PUT latency.
Python virtual filesystem for SQLite to read from and write to S3.
A deep dive into the structure and performance benefits of Parquet files, including columnar storage, partitioning strategies, and row groups.
Grafana Loki version 3.4 introduces enhancements such as standardized storage with Thanos, a sizing guidance page, merging of Promtail into Grafana Alloy, and support for out-of-order logs.
A detailed exploration of Amazon S3 Tables, a new solution for scalable storage and management of tabular data leveraging Apache Iceberg, including features, setup, security, and benefits over traditional storage methods.
The article provides an overview of 12 essential Web APIs every developer should know, including Storage API, Payment Request API, DOM API, HTML Sanitizer API, Canvas API, History API, Clipboard API, Fullscreen API, FormData API, Fetch API, Drag and Drop API, and Geolocation API. Each API is explained with code examples.
