infrastructure

Tech Optimizer
July 22, 2026
Nubank, a digital banking platform with approximately 135 million customers in Brazil, Mexico, and Colombia, faced challenges with its payment infrastructure due to inefficiencies in managing 7.5 TB of self-hosted PostgreSQL databases. Queries took over 13 minutes to execute, and replication lags exceeded four minutes during peak times. To address these issues, Nubank evaluated database solutions based on developer productivity, operational efficiency, performance reliability, and scalability. They selected Amazon Aurora PostgreSQL-Compatible Edition for its compatibility, performance improvements, and automated features. The migration to Aurora was facilitated by AWS Database Migration Service (AWS DMS), which minimized downtime and allowed for efficient transition. Post-migration, query performance improved significantly, with some queries executing up to 1,900 times faster, and overall end-to-end service latency decreased, enhancing customer experience. The migration resulted in a 25 percent cost reduction and ensured compliance with regulatory requirements.
Tech Optimizer
July 22, 2026
Google has introduced a preview of its columnar engine-accelerated HNSW feature for AlloyDB, enhancing vector search throughput by up to four times for users of the pgvector extension in PostgreSQL. This improvement is aimed at approximate nearest neighbor searches using HNSW across large datasets. AlloyDB utilizes a columnar engine that allows HNSW indexes to reside in memory, improving throughput and recall metrics. In benchmark tests on the GloVe 100 Angular dataset, queries per second increased by approximately 4.2x to 4.9x, with recall improving from about 0.78 to over 0.94 at a throughput of around 350 queries per second. The columnar engine's design bypasses traditional PostgreSQL buffer management bottlenecks, enhancing efficiency during graph traversal. The memory architecture is distinct from basic caching techniques, and the feature requires no changes to application code. Users must enable the columnar engine and index caching flags to utilize this feature. Benchmarks were conducted on an AlloyDB C4A machine with 16 virtual CPUs.
Tech Optimizer
July 21, 2026
The author transitioned from a data analyst role to a data engineer, creating a 12-month self-study roadmap focused on learning by building projects. The first project was a GitHub ETL pipeline, which evolved from a simple Python script to a more complex system using SQLite and GitHub Actions for automation. The author realized that the challenges of data engineering lay in system design and orchestration rather than just writing ETL logic. For the second project, the author built an automated RSS ingestion pipeline to explore engineering decisions in creating a reliable data pipeline. The project emphasized the importance of separating application responsibilities from orchestration tasks, leading to the use of Docker for consistent execution environments and Kestra for orchestration. The author validated each component of the project incrementally: first the Python ETL, then PostgreSQL, followed by Docker, and finally Kestra. This approach ensured that each layer functioned correctly before adding complexity. The final architecture included distinct responsibilities for each component: Python for data processing, PostgreSQL for data storage, Docker for execution, and Kestra for orchestration. The author learned that effective engineering involves considering system reliability, error handling, and observability, shifting the focus from merely writing code to designing entire systems. The experience transformed the author's mindset, emphasizing the importance of incremental building and the separation of execution and orchestration responsibilities.
AppWizard
July 21, 2026
X has launched a revamped version of its Android app, a project that began nearly a year ago in response to user feedback about bugs and performance issues. The initiative was first mentioned in August 2025 when Nikita Bier, the Head of Product, sought to create the "Android Dream Team." On July 20, Bier announced the completion of the rebuild, describing it as one of the largest engineering efforts in the company's history. The new app is faster, smoother, and more reliable, with a modernized foundation that will facilitate quicker feature rollouts in the future. Although the update does not introduce new user-facing features, it focuses on performance enhancements, including improvements to scrolling, loading, and notifications. Future updates are promised to include additional functionalities, such as better support for hosting Spaces and improved performance on older devices.
Tech Optimizer
July 18, 2026
North Korea's Contagious Interview hackers have been using a deceptive strategy to target developers by posing as recruiters and embedding malware in SVG files. Elastic Security Labs discovered that the attackers hid malicious payloads within HTML comment blocks of these files, allowing the malware to evade antivirus detection. At the time of the findings, no antivirus engines flagged the compromised repositories, which included trojanized GitHub repositories disguised as coding challenges. The malware executed automatically at server startup and deployed four modules: a browser credential and cryptocurrency wallet stealer, a file stealer, a remote access Trojan, and a clipboard monitor. The campaign, tracked as REF9403, is part of the ongoing Contagious Interview operation attributed to North Korea's Lazarus Group, which aims to generate revenue through cryptocurrency theft. Developers are advised to audit any projects run from unsolicited sources and to monitor specific domains associated with the attack.
AppWizard
July 16, 2026
Google will introduce rival Android app stores within its Play Store starting July 22, following a court ruling that mandates the inclusion of competing app stores. This change allows cryptocurrency applications greater visibility while still processing downloads through Google Play, which will maintain its service fee. Competing app stores must be U.S.-based, keep malware rates below 1%, and pay an annual fee of ,000. The order is temporary, lasting until November 1, 2027, and prohibits Google from incentivizing device manufacturers to prioritize its own store.
Search