engine Archives

Tech Optimizer

July 8, 2025

How TimescaleDB helped us scale analytics and reporting

At Cloudflare, PostgreSQL and ClickHouse are used as primary databases for transactional and analytical workloads. PostgreSQL is preferred for product development due to its speed, versatility, and reliability, with hundreds of instances running in various configurations. ClickHouse, introduced in 2017, allows ingestion of tens of millions of rows per second with millisecond-level query performance but comes with trade-offs. The Digital Experience Monitoring (DEX) product was developed with a focus on simplicity and rapid shipping, utilizing a team of three engineers and collaboration with other teams. DEX's initial launch included fleet status logs uploaded every two minutes and synthetic tests with usage caps, leading to a successful MVP launch ahead of schedule. The architecture included an HTTP API, PostgreSQL for storing configurations, and a React UI in the Cloudflare Dashboard. PostgreSQL was chosen for analytics due to its ability to handle structured logs, with a table created for device state logs lacking a primary key but optimized with unique and standard indexes for common queries. The UPSERT query was used for data insertion, and the order of columns in multicolumn indexes was optimized for performance. After launching DEX, the system scaled to 1,000 inserts per second, leading to performance degradation. Precomputed aggregates were implemented to improve query performance, resulting in up to a 1000x improvement. Table partitioning was considered but ultimately not pursued due to its manual management requirements. TimescaleDB was explored as an alternative to enhance query performance, offering features like automatic partition management, continuous aggregates, and compression. A side-by-side comparison with PostgreSQL showed significant performance improvements, particularly for longer time windows. TimescaleDB's integration allowed for efficient data retention and aggregation, simplifying the infrastructure. Following the success of DEX, other teams at Cloudflare began using TimescaleDB for analytics and reporting, consolidating data from various sources and managing high ingestion rates effectively by optimizing data handling techniques such as switching to COPY for bulk inserts and adjusting replication settings.

Tech Optimizer

July 8, 2025

PostgreSQL Mistakes and How to Avoid Them, Video Edition

The content describes a video edition of a book titled "PostgreSQL Mistakes and How To Avoid Them," which aims to help readers learn from common PostgreSQL errors. The book covers various topics, including avoiding configuration and operational issues, maximizing utility and performance, rectifying poor SQL practices, addressing security and administration challenges, facilitating migrations and upgrades, and diagnosing problematic databases. It provides detailed explanations of mistakes, real-world examples, and actionable recommendations, along with illustrative code snippets and diagrams. The book is intended for PostgreSQL database administrators and application developers, and the author is Jimmy Angelakos, a systems and database architect.

AppWizard

July 8, 2025

Unless users take action, Android will let Gemini access third-party apps

Google is rolling out an update that allows its Gemini AI engine to interact with third-party applications, including WhatsApp, regardless of users' previous privacy settings. Users are advised to take proactive measures if they want to maintain their privacy. An email from Google indicated that human reviewers process the data accessed by Gemini and mentioned that while users can block app interactions, data will still be retained for 72 hours. The email did not provide clear instructions for completely disengaging Gemini from Android devices, leading to confusion about the implementation of these changes.

AppWizard

July 7, 2025

Romero Games have “completely” closed doors, but there’s still hope for the Doom creator’s new FPS

Romero Games has ceased operations after funding for their first-person shooter was withdrawn, affecting approximately 100 employees. An anonymous employee described the situation as a "big shock," noting that discussions with a publisher occurred just a day before the closure. The project was reportedly well-developed and had received positive feedback, but is now completely closed while the studio seeks alternative funding. The unnamed FPS had generated significant interest, and the Chief Technical Officer is advocating for former staff on LinkedIn. The game was announced in 2022 and was being developed using Unreal Engine 5. Prior to this, Romero and Carmack worked on a canceled game called Blackroom in 2016.

Winsage

July 7, 2025

Microsoft will use the Windows 11 lock screen to recommend widgets

Microsoft is introducing widget recommendations on the Windows 11 lock screen to suggest widgets that may interest users. This feature, called the Discover Widget, is currently in a preview build and does not have a specific rollout date. The initiative aims to increase user engagement with widgets, which have seen slow adoption on Windows 11 compared to other platforms. The reception of this feature is uncertain due to past user skepticism towards recommendation systems in Windows 11.

AppWizard

July 5, 2025

I wouldn’t be able to use my gaming PC without this one mod

Special K is a versatile utility for PC gaming that enhances gameplay across various titles. It features a frame rate limiter that improves consistency, surpassing Nvidia's built-in limiter in minimum frame rates during tests. Special K allows users to force games into borderless or exclusive fullscreen modes, enable Nvidia Reflex, adjust DLSS settings, and link input devices to specific applications. It also addresses HDR support issues by enabling HDR injection in games that lack native support, with extensive customization options for HDR settings. Originally developed to fix problems in PC ports like Fallout 4 and Batman: Arkham Knight, it has evolved to optimize a wide range of games, including Elden Ring, Monster Hunter: World, and Final Fantasy VII Remake. Special K has limitations with online games due to anti-cheat concerns but is highly applicable for single-player titles. The introduction of the SKIF GUI has made it more accessible for users.

AppWizard

July 5, 2025

What happened to the creator of Gunman Chronicles, Valve’s forgotten FPS? ‘My relationship with Gabe didn’t really go that great’

Gunman Chronicles is a first-person shooter developed in 2000 by Valve and Rewolf Software. The game features programmable weapons and dinosaurs, which are a significant aspect of its appeal. Despite its unique qualities, Gunman Chronicles is not available for purchase on Steam or any other platform. The game's development was led by Herbert Flower, who began his journey in game development with an Atari ST and created a mod for Doom that evolved into Gunman Chronicles. The project received funding from Valve, but the development process was challenging, leading to strained relationships within the team. Upon its release on November 21, 2000, the game received mixed reviews and modest sales. Afterward, Flower transitioned to forming Mythyn Interactive and later shifted focus to running a photogrammetry business named Goatogrammetry.

AppWizard

July 5, 2025

Here’s a mod that puts Halo’s multiplayer into Half-Life, which to me feels like putting tea in your coffee

Modders have created a project called Halo Goldsource, which merges the Halo and Half-Life franchises by recreating Halo's multiplayer experience using the Half-Life engine. The mod includes familiar game modes like Slayer and Firefight, along with remade maps and original arenas. However, it struggles to capture Halo's unique movement mechanics and lacks vehicles, which are essential to the Halo experience. This results in gameplay that feels different from traditional Halo, potentially disappointing purists who prefer the original games.

AppWizard

July 4, 2025

Publisher pulls funding for Romero Games project

Romero Games has lost funding for its in-development project, leading to potential layoffs or significant changes within the organization. The studio was developing a first-person shooter using Unreal Engine 5, which had received backing from an undisclosed major publisher, speculated to be Microsoft. Studio head Brenda Romero announced the funding cancellation in a message, emphasizing that the team's dedication and performance were not at fault, as they consistently met all milestones and received positive feedback. The news has had an emotional impact on the team, many of whom have long-standing relationships.

AppWizard

July 4, 2025

Valve conquered PC gaming. What comes next?

Valve Corporation, founded in 1996 by Gabe Newell and Mike Harrington, is known for its influential role in the gaming industry, particularly with its groundbreaking title Half-Life, released in 1998. The company has a unique corporate structure and impressive revenue-per-employee metrics, reportedly exceeding .9 million. Valve's Steam platform, launched in 2003, dominates the PC gaming market, accounting for approximately 70% of sales in a sector valued at around billion, with over 100,000 titles available. Steam had an estimated 170 million active monthly users by May 2023. Financially, estimates suggest Steam may have handled around .3 billion in game sales in 2021, yielding a profit of approximately .6 billion from commissions. Valve's employee culture emphasizes self-organization and innovation, though it faces scrutiny regarding content moderation and legal challenges related to market competition.