Database on firstfinger

How Does Your Database Store Millions of Records?

Thu, 01 Jan 2026 17:54:09 +0000

Every time you save a photo, complete a purchase, or send a message, your data travels from application code to permanent storage. But how does this actually work at the physical level?

During my years working with production systems, I’ve seen teams choose the wrong storage engine and suffer 10x performance penalties. The difference between B-Trees and LSM Trees isn’t academic, it’s the reason Discord’s migration to Cassandra made their writes 10x faster, and why Netflix uses different approaches for viewing history versus recommendations.

Why Your App is Still Slow After Optimization?

Sat, 30 Aug 2025 12:31:22 +0000

You have optimized your database queries, your API responds in under 100ms, and your CDN is correctly configured. Yet users still report slow load times, and performance monitoring shows latency spikes that appear without explanation.

The issue often lies outside your application or infrastructure. Two core network protocols can directly impact performance. TCP congestion control may make inefficient decisions about how data flows under varying conditions, and BGP routing can send traffic along longer, suboptimal paths across the internet.

Ansible vs Terraform

Tue, 02 Apr 2024 20:00:50 +0000

Imagine, As your business grows bigger, setting up and configuring things like servers, databases, and networks becomes a real pain if you do it by hand. Spinning up new servers one by one, copying and pasting commands, and keeping track of everything is super time-consuming and mistakes happen easily. Keeping all your servers configured the same way, installing updates, and deploying new code versions is a nightmare without help.

That’s where tools like Terraform and Ansible come to the rescue. Terraform is awesome at setting up your infrastructure like servers, networks, and databases. Instead of doing everything manually, you write code that describes what you want, and Terraform handles it for you. Need 10 new servers? Terraform gets it done with just a few commands.

Deploying WordPress with MySQL, Redis, and NGINX on Docker

Wed, 27 Mar 2024 11:53:41 +0000

WordPress is a popular content management system (CMS) that powers millions of websites worldwide. However, as your website grows, you may experience performance issues. To improve WordPress performance, you can use object caching, which stores frequently accessed data in memory, reducing the number of database queries.

Prerequisites:

Basic knowledge of Docker and Docker Compose
Docker & Docker Compose installed on your machine
A domain name or IP address pointing to your server

Why do we need better performance in WordPress?

Website performance is crucial for user experience and search engine optimization (SEO). A slow website can lead to a high bounce rate, meaning visitors leave your site without interacting. Additionally, search engines like Google consider website speed as a ranking factor.

Setup Memos Note-Taking App with MySQL on Docker & S3 Storage

Fri, 22 Mar 2024 20:05:09 +0000

What is Memos?

Memos is an open-source, privacy-first, and lightweight note-taking application service that allows you to easily capture and share your thoughts.

Memos features:

Open-source and free forever
Self-hosting with Docker in seconds
Pure text with Markdown support
Customize and share notes effortlessly
RESTful API for third-party integration

Self-Hosting Memos with Docker and MySQL Database

You can self-host Memos quickly using Docker Compose with a MySQL database.

Why You Should Use Vectorization Instead of Loops in Python?

Sun, 14 Jan 2024 02:08:48 +0000

I’ve often come across scenarios where efficiency and speed are of the essence, especially when dealing with large datasets or complex numerical computations. One technique that consistently proves its worth in such situations is vectorization.

I’ll explain why vectorization should be your go-to approach over traditional loops in Python, especially when dealing with array operations.

What is Vectorization in Python?

Vectorization, in the context of Python, refers to the use of optimized, pre-compiled functions that can operate on entire arrays or sequences of data at once, instead of processing each element individually. This is particularly effective when using libraries like NumPy, which is designed for efficient numerical computations.

In-Memory Caching vs. In-Memory Data Store

Sat, 13 Jan 2024 15:13:35 +0000

In-memory caching and in-memory data storage are both techniques used to improve the performance of applications by storing frequently accessed data in memory. However, they differ in their approach and purpose.

What is In-Memory Caching?

In-memory caching is a method where data is temporarily stored in the system’s primary memory (RAM). This approach significantly reduces data access time compared to traditional disk-based storage, leading to faster retrieval and improved application performance.

Should You Use Open Source Large Language Models?

Sun, 10 Dec 2023 15:34:28 +0000

Large language models (LLMs) powered by artificial intelligence are gaining immense popularity, with over 325,000 models available on Hugging Face. As more models emerge, a key question is whether to use proprietary or open-source LLMs.

What are LLMs and How Do They Differ?

LLMs leverage deep learning and massive datasets to generate human-like text
Proprietary LLMs are owned and controlled by a company
Open-source LLMs are freely accessible for anyone to use and modify
Proprietary models currently tend to be much larger in terms of parameters
However, size isn’t everything - smaller open-source models are rapidly catching up
Community contributions empower the evolution of open-source LLMs

How Do (LLM) Large Language Models Work? Explained

A large language model (LLM) is an AI system trained on extensive text data, designed to produce human-like and intelligent responses.

How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

Thu, 07 Dec 2023 13:30:46 +0000

These two Companies OneUptime and Prerender are finding that migrating from Amazon Web Services (AWS) to bare metal servers hosted in colocation data centres can lead to substantial cost savings. They have cut costs by over 50% by taking control of their infrastructure while maintaining performance and reliability.

OneUptime was spending $456K+ annually on a 28-node AWS Kubernetes cluster.
Prerender projected over $1M per year on AWS services and data transfer.

📈 The Hidden Costs of Cloud

For many startups and tech companies, AWS seems like an easy choice. It allows you to spin up servers and scale rapidly without investing in your hardware upfront. But as these companies grow, the operating costs on AWS start to add up:

Monolithic vs Microservices Architecture

Tue, 28 Nov 2023 06:23:11 +0000

As software systems scale in complexity, architects must decide whether a monolithic or microservices architecture is the best choice. This decision greatly impacts system scalability, fault tolerance, ease of development, and more for years to come.

1. Monolithic Architecture

In a monolithic design, all critical application components are combined into a single, tightly integrated unit. The components are heavily dependent on each other and communicate via language-level interfaces. The entire software system scales and is deployed as one. Performance can be greatly optimized via shared state and function calls between components. The data model is enforced in a single database.

How to Achieve Zero Downtime Deployments with Blue-Green Deployment in Kubernetes?

Fri, 17 Nov 2023 04:21:06 +0000

Being able to update software without stopping it is really important for keeping customers happy and making sure everything keeps running smoothly. That’s where zero downtime deployment comes in. It helps you switch between different versions of a program without any interruptions. One of the best ways to do this is through Blue-Green Deployment.

<b><strong>What is Zero Downtime Deployment?</strong></b>

Zero downtime deployment, also known as zero-downtime release, refers to a deployment strategy that ensures continuous availability of an application during the deployment process. This means that users can continue to access the application without experiencing any disruptions or service interruptions.

How to Scale Your Database: Strategies & Performance

Tue, 29 Aug 2023 14:41:47 +0000

As an application grows, so does the load on its database. A database that can’t keep up with demand will lead to slow response times, timeouts, and outages. Scaling a database involves making changes to handle increased workloads while maintaining performance and availability.

In this article, we’ll explore common database scaling techniques, steps to scale out a relational database, and key considerations when planning a database scaling strategy.

What is Database Scaling & Why it Matters?

Database scaling refers to methods of increasing a database’s capacity and processing power to handle more data and workload.

What Are the Different Types of Databases?

Fri, 04 Aug 2023 15:56:53 +0000

A database is a collection of data that is organized so that it can be easily accessed, managed, and updated. Databases are essential for storing and retrieving information in various applications, such as websites, mobile apps, online services, and business systems.

There are different types of databases, each with its own advantages and disadvantages. In this blog post, we will explore some of the most common types of databases and how they work. We will focus on two main categories: relational/SQL databases and NoSQL databases.

9 Best Practices for Developing Microservices

Fri, 21 Jul 2023 23:22:45 +0000

Microservices architecture has gained significant popularity in recent years due to its ability to enhance scalability, agility, and resilience in software development. However, building effective microservices requires careful planning decisions to best practices. We can gain higher agility, scalability, and resilience by splitting down monolithic apps into smaller, independent services.

In this article, we will explore 9 essential best practices for developing microservices, covering topics such as data storage, code maturity, build separation, single responsibility, container deployment, stateless services, domain-driven design, micro frontends, and microservices orchestration.* *Let’s first understand what are Microservices?

DevOps vs GitOps: Streamlining Development and Deployment

Wed, 12 Jul 2023 01:55:40 +0000

DevOps vs GitOps

In SDLC (Software Development Life Cycle), organizations are constantly seeking ways to *improve their processes and achieve efficient, reliable, and scalable deployment. *While DevOps & GitOps both aim to enhance software delivery, they differ in their methodologies and underlying principles.

First off, let’s get straight. What exactly are DevOps and GitOps?

How Do DevOps & GitOps Methodologies Differ?

What is DevOps?

**DevOps is a collaborative **software development approach that highlights the integration of development (Dev) and operations (Ops) teams throughout the software development lifecycle. It aims to establish a culture of continuous integration, continuous delivery (CI/CD), and automation, enabling organizations to deliver software faster, with higher quality and stability.

System Design vs Software Architecture : What You Need to Know

Mon, 03 Jul 2023 00:38:30 +0000

System Design Vs Software Architecture

Have you ever found yourself in a confusing situation, trying to differentiate between system design and software architecture? System design and software architecture are two crucial concepts that play vital roles in building robust and scalable applications. While these terms are often used interchangeably, they have distinct characteristics and purposes. This article aims to explore the differences between system design and software architecture, their relationship.

What Makes Load Balancer vs. API Gateway Different and Use Cases ?

Wed, 21 Jun 2023 09:25:15 +0000

Load Balancer vs. API Gateway

If you are developing a web or mobile application, you may need to use some tools to manage the traffic and access to your backend services. Two of these tools are load balancers and API gateways. We’ll explore what makes them unique, how they work together, and which one is best for different use cases.

You’ll learn about their features, advantages, and disadvantages so you can make an informed decision about what works best for your needs. We’ll also discuss their common use cases and how they fit into your overall system architecture.

The Most Popular APIs: REST, SOAP, GraphQL , and gRPC Explained

Wed, 14 Jun 2023 21:15:51 +0000

The Most Popular APIs: REST, SOAP, GraphQL, and gRPC

Application Programming Interfaces (APIs) play a crucial role in enabling communication between different systems and applications. They provide a consistent way for applications to interact with each other, allowing developers to integrate functionality and exchange data seamlessly. It is important for both application architects and backend developers to have knowledge about which APIs are most suitable for specific applications.

In this article, we will look at the similarities and differences between SOAP, REST, GraphQL, and gRPC APIs. This will provide you with an understanding of their advantages and disadvantages, typical applications, and other factors to consider when selecting the most suitable option for your requirements.

Optimizing Content Delivery with AWS Lambda@Edge vs. CloudFront

Sat, 10 Jun 2023 00:48:01 +0000

AWS Lambda@Edge vs. CloudFront

When it comes to delivering fast and reliable content to users across the globe, Amazon Web Services (AWS) offers a range of powerful tools and services. Two popular options are AWS Lambda Edge and AWS CloudFront. These services play a crucial role in optimizing the performance of web applications and ensuring a seamless user experience. First let’s understand “Caching” and how does it work?

What is Caching?

Caching is a technique that improves the performance and efficiency of web applications by storing frequently used data in a temporary storage area called a cache. A cache can be located on the client-side (browser), server-side (web server), or network-level (proxy server).

What's the Difference Between Git Clone and Git Fork ?

Fri, 09 Jun 2023 21:47:28 +0000

What’s the Difference Between Git Fork and Git Clone?

Git is a popular distributed version control system that is used by developers all over the world. Git has become one of the most popular tools for developers. It allows multiple contributors to work on a project simultaneously while maintaining a complete history of changes.

Git allows developers to track changes made to their code over time, collaborate with other developers, and more. However, new developers who are just starting to learn Git may get confused between certain Git commands, like Git Fork and Git Clone. Although they share some similarities, but they are distinct concepts with separate objectives. The purpose of this article is to clarify the difference between them, as it is crucial for effective collaboration and repository management.

What is Vector Database and How does it work?

Thu, 08 Jun 2023 18:03:47 +0000

Recently, Vector databases have gained significant attention, with companies raising hundreds of millions of dollars to build them. Many consider them a revolutionary database for the AI era. However, while they are fascinating and offer numerous applications, they may not always be the optimal solution for every project. In some cases, a traditional database or even a numpy ND array could suffice.

Overview of Vector Databases

Nonetheless, there’s no denying that Vector databases are highly intriguing and offer numerous compelling applications, especially when it comes to providing extensive memory to large language models like GPT-4.

What are HSTS and CSP Security Headers and the Difference Between Them?

Thu, 08 Jun 2023 13:39:38 +0000

If you’re a web developer or a website owner, you may have heard about HSTS and CSP security headers. Two commonly used security measures are HSTS (HTTP Strict Transport Security) and CSP (Content Security Policy) headers. These headers play a vital role in protecting both users and websites from various types of attacks. With the increasing threat of cyber attacks, it’s crucial for website owners to implement strong security measures.

What is Database Sharding?

Mon, 29 May 2023 08:34:59 +0000

Databases can grow exponentially over time as your business expands, making it difficult to manage, retrieve data, and maintain efficiency. This problem can be further compounded when multiple users try to access the data concurrently.

Database

As the volume of data grows, traditional database architectures may struggle to handle the load efficiently. This is where database sharding comes into play.

📁 What is Database Sharding?

Database sharding is a technique that splits a database into smaller, easily manageable shards while still maintaining uniformity across them. Shards are then stored on different servers, which can improve performance and scalability.

What is Apache Kafka & Why it is fast?

Wed, 24 May 2023 14:53:25 +0000

In today’s fast-paced digital world, businesses require solutions that can handle massive data volumes and process them in real-time. This is where Apache Kafka comes in. Apache Kafka has quickly become the preferred option for real-time data streaming across various industries. But what is Apache Kafka, and how does it achieve such impressive speed and performance?

*More than ****80% of all Fortune 100 companies ***trust, and use Kafka.

♨️ What is Apache Kafka?

Apache Kafka