A database is a structured set of data stored in a computer designed for efficient storage, retrieval, and maintenance.

Normalized databases are optimized to reduce data redundancy.

A stack is a linear data structure that uses the LIFO(Last In First Out) method.

SQL is used to store, manipulate, and retrieve data in relational database management systems.

An individual entry in a table of a database is known as record or row.

information online is stored in databases. A database is really just a
list-but the computer or program has to be able to be able to parse and
use what's inside the list. This means someone-the programmer-must
choose what questions will be asked and what options the user will have
in responding: Man or Woman? Married or Single? Gay or Straight? It gets
very easy to feel left out. Or old: 0-12, 13-19, 20-34, 35-48, or 49-75?
The architecture of databases requires the programmer to pick the
categories that matter, and at the granularity that matters

[How to build a IP geolocation database from scratch? | Hacker News](https://news.ycombinator.com/item?id=37507355)
[ipapi.is - Geolocation](https://ipapi.is/geolocation.html)
database is already in TB

(look up Oracle DB model)

## 0 databases

[I put my whole life into a single database | Hacker News](https://news.ycombinator.com/item?id=31186696)
[How I put my whole life into a single database · Felix Krause](https://krausefx.com//blog/how-i-put-my-whole-life-into-a-single-database)
[Felix Krause](https://krausefx.com/)

[A database for 2022 | Hacker News](https://news.ycombinator.com/item?id=30883015)
[A database for 2022](https://tailscale.com/blog/database-for-2022)

[A routine gem update ended up creating $73k worth of subscriptions | Hacker News](https://news.ycombinator.com/item?id=29845724)
[How a routine gem update ended up creating $73k worth of subscriptions](https://serpapi.com/blog/how-a-routine-gem-update-ended-up-charging/)

[GitHub - merdoyovski/awesome-database: A curated list of amazingly awesome database libraries and resources.](https://github.com/merdoyovski/awesome-database)

[State of Databases Survey - 2023](https://stateofdb.com/)

## 1 data mining

[Supercentenarian records show patterns indicative of errors and pension fraud | Hacker News](https://news.ycombinator.com/item?id=35441997)
[Supercentenarian and remarkable age records exhibit patterns indicative of clerical errors and pension fraud | bioRxiv](https://www.biorxiv.org/content/10.1101/704080v2)
[bioRxiv](https://www.biorxiv.org/)
- the quality of the data in the first place is MUCH more important than the mining or cleaning of it

[5 must-have features for a data importer | Flatfile](https://flatfile.com/blog/5-must-have-features-for-a-data-importer)

## 3 data analysis

[ROOT: analyzing petabytes of data scientifically | Hacker News](https://news.ycombinator.com/item?id=40543651)
[ROOT: analyzing petabytes of data, scientifically. - ROOT](https://root.cern/)

[Insights Found By Analyzing My Text Messages](http://integritydatainsights.com/insights-found-by-analyzing-my-text-messages/)

## big data

[Truveta's big data healthcare project is pretty cool | TechCrunch](https://techcrunch.com/2022/11/07/truvetas-big-data-healthcare-project-is-pretty-cool)

[Big data is dead | Hacker News](https://news.ycombinator.com/item?id=34694926)
[Big Data is Dead](https://motherduck.com/blog/big-data-is-dead/)

[GitHub - buaaliuming/Awesome-Resources-for-Scholarly-Big-Data: Tools, datasets, Corpus and Venue Challenge for scholarly big data--Pick up scattered pearls](https://github.com/buaaliuming/Awesome-Resources-for-Scholarly-Big-Data)

## CSS-based databases

[Yes, I can connect to a DB in CSS | Hacker News](https://news.ycombinator.com/item?id=30191729)
[Yes, I can connect to a DB in CSS](https://www.leemeichin.com/posts/yes-i-can-connect-to-a-db-in-css.html)

## CSV

[Modern CSV version 2 | Hacker News](https://news.ycombinator.com/item?id=37140159)
[Modern CSV 2 is now available. - Modern CSV](https://www.moderncsv.com/modern-csv-2-is-now-available/)

[python I'm trying to output the already formatted contents of a CSV file into a text channel, but when I do so it's in unordered rows. How can I fix it? Stack Overflow](https://stackoverflow.com/questions/64321503/im-trying-to-output-the-already-formatted-contents-of-a-csv-file-into-a-text-ch)

## database bounties

[US Presidential Election $25,000 Database Bounty Review | DoltHub Blog](https://www.dolthub.com/blog/2021-02-15-election-bounty-review)

## database comparisons

[The Great Migration from MongoDB to PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=39860769)
[The Great Migration from MongoDB to PostgreSQL](https://infisical.com/blog/postgresql-migration-technical)

[Why are NoSQL databases more scalable than SQL?](https://softwareengineering.stackexchange.com/questions/194340/why-are-nosql-databases-more-scalable-than-sql/194408#194408)

[A Comparison of NoSQL Database Management Systems and Models | DigitalOcean](https://www.digitalocean.com/community/tutorials/a-comparison-of-nosql-database-management-systems-and-models)
Comparison between NoSQL database models

[SQL vs. NoSQL Databases: What's the Difference? - IBM Blog](https://www.ibm.com/blog/sql-vs-nosql/)

[SQLite vs MySQL vs PostgreSQL: A Comparison Of Relational Database Management Systems | DigitalOcean](https://www.digitalocean.com/community/tutorials/sqlite-vs-mysql-vs-postgresql-a-comparison-of-relational-database-management-systems)
Comparison between some popular SQL databases

[Offline-First Database Comparison | Hacker News](https://news.ycombinator.com/item?id=28995268)
[pubkey/client-side-databases: An implementation of the exact same app in Firestore, AWS Datastore, PouchDB, RxDB and WatermelonDB](https://github.com/pubkey/client-side-databases)

## database design

[Database Design for Google Calendar: A Tutorial | Hacker News](https://news.ycombinator.com/item?id=41043371)
[Database Design for Google Calendar: a tutorial | Database Design Book](https://kb.databasedesignbook.com/posts/google-calendar/)

## database failures

[Technical explanation help please: how could whole air traffic control system fail due to a single piece of data in a flight plan that was wrongly input to its system by an airline?](https://old.reddit.com/r/programming/comments/169wt7u/technical_explanation_help_please_how_could_whole/)

[327: Exploits of a Mom - explain xkcd](https://www.explainxkcd.com/wiki/index.php/327:_Exploits_of_a_Mom)

## database indexes

[Spending $5k to learn how database indexes work | Hacker News](https://news.ycombinator.com/item?id=29132572)
[Spending $5k to learn how database indexes work // Brian Anglin](https://www.briananglin.me/posts/spending-5k-to-learn-how-database-indexes-work/)

## database migration

[Migrating Uber's ledger data from DynamoDB to LedgerStore | Hacker News](https://news.ycombinator.com/item?id=40413891)
[Migrating Uber's Ledger Data from DynamoDB to LedgerStore | Uber Blog](https://www.uber.com/blog/migrating-from-dynamodb-to-ledgerstore/)

[Database Migrations](https://vadimkravcenko.com/shorts/database-migrations/)

## database programming

[Accidental database programming | Hacker News](https://news.ycombinator.com/item?id=38489307)
[SQLSync - Stop building databases](https://sqlsync.dev/posts/stop-building-databases/)

## database storage

[Understanding Parquet, Iceberg and Data Lakehouses | Hacker News](https://news.ycombinator.com/item?id=38811576)
[Understanding Parquet, Iceberg and Data Lakehouses at Broad](https://davidgomes.com/understanding-parquet-iceberg-and-data-lakehouses-at-broad/)

## dataflow

[How Spotify Optimized the Largest Dataflow Job Ever for Wrapped 2020 - Spotify Engineering : Spotify Engineering](https://engineering.atspotify.com/2021/02/how-spotify-optimized-the-largest-dataflow-job-ever-for-wrapped-2020)

## data modeling

[Navicat Data Modeler | Supreme Database Modeling and Design Tool](https://www.navicat.com/en/products/navicat-data-modeler)

[ORM Design Tool  Meteor Modeler](https://www.datensen.com/orm-design-tool/meteor-modeler-for-orm.html)

[Moon Modeler  Draw ER Diagrams for your Data Models](https://www.datensen.com/data-modeling/moon-modeler-for-databases.html)

## DuckDB

[DuckDB Doesn't Need Data to Be a Database | Hacker News](https://news.ycombinator.com/item?id=40509987)
[DuckDB Doesn’t Need Data To Be a Database](https://www.nikolasgoebel.com/2024/05/28/duckdb-doesnt-need-data.html)

## dynamic memory allocation

[A database without dynamic memory allocation | Hacker News](https://news.ycombinator.com/item?id=33192288)
[A Database Without Dynamic Memory Allocation | TigerBeetle](https://tigerbeetle.com/blog/a-database-without-dynamic-memory/)

## graph database

[Bullshit graph database performance benchmarks | Hacker News](https://news.ycombinator.com/item?id=34342371)
[Bullshit Graph Database Performance Benchmarks | Max De Marzi](https://maxdemarzi.com/2023/01/11/bullshit-graph-database-performance-benchmarks/)

## history

[Databases in 2022: A Year in Review | Hacker News](https://news.ycombinator.com/item?id=34220524)
[Databases in 2022: A Year in Review | OtterTune](https://ottertune.com/blog/2022-databases-retrospective)

[Databases in 2021: A Year in Review | Hacker News](https://news.ycombinator.com/item?id=29731885)
[Databases in 2021: A Year in Review | OtterTune](https://ottertune.com/blog/2021-databases-retrospective)

## implicit typing

[The Norway Problem | Hacker News](https://news.ycombinator.com/item?id=26671136)
[The Norway Problem - why StrictYAML refuses to do implicit typing and so should you - HitchDev](https://hitchdev.com/strictyaml/why/implicit-typing-removed/)

## keys

[You'll regret using natural keys | Hacker News](https://news.ycombinator.com/item?id=40580549)
[You'll regret using natural keys](https://blog.ploeh.dk/2024/06/03/youll-regret-using-natural-keys/)

## LINQ

[LINQ (Language-Integrated Query) | Microsoft Learn](https://learn.microsoft.com/en-us/previous-versions/bb397926(v=vs.140)?redirectedfrom=MSDN)

## MariaDB

[MariaDB to go public at $672M valuation | Hacker News](https://news.ycombinator.com/item?id=30163983)
[MariaDB Corporation Ab to Become a Publicly Traded Company via Combination with Angel Pond Holdings Corporation | MariaDB](https://mariadb.com/newsroom/press-releases/mariadb-corporation-ab-to-become-a-publicly-traded-company-via-combination-with-angel-pond-holdings-corporation/)

## MySQL

[TIME for a WTF MySQL moment | gbl08ma's personal website](https://gbl08ma.com/time-for-a-wtf-mysql-moment)

[In MySQL, use "utf8mb4" instead of "utf8" (2016) | Hacker News](https://news.ycombinator.com/item?id=29907551)
[In MySQL, never use "utf8". Use "utf8mb4". | by Adam Hooper | Medium](https://adamhooper.medium.com/in-mysql-never-use-utf8-use-utf8mb4-11761243e434)

[Leaving MySQL | Hacker News](https://news.ycombinator.com/item?id=29455852)

[Jepsen: MySQL 8.0.34 | Hacker News](https://news.ycombinator.com/item?id=38695750)
[Jepsen: MySQL 8.0.34](https://jepsen.io/analyses/mysql-8.0.34)

[Migrating Facebook to MySQL 8.0 | Hacker News](https://news.ycombinator.com/item?id=27922097)
[Migrating Facebook to MySQL 8.0 - Engineering at Meta](https://engineering.fb.com/2021/07/22/data-infrastructure/mysql/)

[GitHub - ty4z2008/Qix: Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang](https://github.com/ty4z2008/Qix)
[启示录 by ty4z2008](https://blog.microdba.com/Qix/)

## NoSQL

[Matt Butcher](https://dzone.com/articles/nosql-no-more)
(2014) NoSQL No More / NoSQL is not a silver bullet

[Kenneth Truyers](https://www.kenneth-truyers.net/2016/10/13/git-nosql-database/)
(2016) Git as a NoSql database

[Lieven Vaneeckhaute (denshade)](https://softwareefficiency.wordpress.com/2015/03/14/big-data-technology-and-the-responsibility-shift/)
(2015) NoSQL and the responsibility shift
about data quality

## NoSQL - MongoDB - Jepsen

[Jepsen: MongoDB 4.2.6 | Hacker News](https://news.ycombinator.com/item?id=23290844)
[Jepsen: MongoDB 4.2.6](https://jepsen.io/analyses/mongodb-4.2.6)

[Jepsen Disputes MongoDB's Data Consistency Claims | Hacker News](https://news.ycombinator.com/item?id=23285249)
[Jepsen Disputes MongoDB's Data Consistency Claims - InfoQ](https://www.infoq.com/news/2020/05/Jepsen-MongoDB-4-2-6/)

[Jepsen: PostgreSQL 12.3 | Hacker News](https://news.ycombinator.com/item?id=23498781)
[Jepsen: PostgreSQL 12.3](https://jepsen.io/analyses/postgresql-12.3)

[Jepsen: Datomic Pro 1.0.7075 | Hacker News](https://news.ycombinator.com/item?id=40369467)
[Jepsen: Datomic Pro 1.0.7075](https://jepsen.io/analyses/datomic-pro-1.0.7075)

## NoSQL - MongoDB

[MongoDB security notice | Hacker News](https://news.ycombinator.com/item?id=38667596)
[Alerts | MongoDB](https://www.mongodb.com/alerts)

## Oracle database

[Dev describes the frustration of making a change to the Oracle Database : programming](https://old.reddit.com/r/programming/comments/16ufgmk/dev_describes_the_frustration_of_making_a_change/)

[Why do so many Linux users hate Oracle? : linux](https://old.reddit.com/r/linux/comments/pnqbpc/why_do_so_many_linux_users_hate_oracle)

## Oracle SQL

[Problems with Oracle SQL | Hacker News](https://news.ycombinator.com/item?id=28483317)
[Oracle SQL Is The Devil - Coding To Freedom](https://web.archive.org/web/20210910105007/https://codingtofreedom.com/oracle-sql-is-the-devil/)

## ORM

[Is ORM still an anti-pattern? | Hacker News](https://news.ycombinator.com/item?id=36497613)
[Is ORM still an 'anti pattern'? · getlago/lago Wiki](https://github.com/getlago/lago/wiki/Is-ORM-still-an-%27anti-pattern%27%3F)

## PostgreSQL

[PostgreSQL 16 | Hacker News](https://news.ycombinator.com/item?id=37508471)
[PostgreSQL: PostgreSQL 16 Released!](https://www.postgresql.org/about/news/postgresql-16-released-2715/)

[PostgreSQL reconsiders its process-based model | Hacker News](https://news.ycombinator.com/item?id=36393030)
[PostgreSQL reconsiders its process-based model [LWN.net]](https://lwn.net/Articles/934940/)

[Postgres is a great pub/sub and job server (2019) | Hacker News](https://news.ycombinator.com/item?id=29599132)
[Postgres is a great pub/sub & job server](https://webapp.io/blog/postgres-is-the-answer/)

[An unexpected find that freed 20GB of unused index space in PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=25988871)
[An unexpected find that freed 20GB of unused index space (2021) | Hacker News](https://news.ycombinator.com/item?id=37294793)
[The Unexpected Find That Freed 20GB of Unused Index Space | Haki Benita](https://hakibenita.com/postgresql-unused-index-size)

[PostgreSQL community impact of 2nd Quadrant purchase | Hacker News](https://news.ycombinator.com/item?id=24710759)
[Bruce Momjian: Postgres Blog](https://momjian.us/main/blogs/pgblog/2020.html#October_7_2020)

[FOSDEM 2019 - PostgreSQL vs. fsync](https://archive.fosdem.org/2019/schedule/event/postgresql_fsync)

[Things I hate about PostgreSQL (2020) | Hacker News](https://news.ycombinator.com/item?id=26709019)
[10 Things I Hate About PostgreSQL | by Rick Branson | Medium](https://rbranson.medium.com/10-things-i-hate-about-postgresql-20dbab8c2791)

[Just use Postgres for everything | Hacker News](https://news.ycombinator.com/item?id=33934139)
[Just Use Postgres for Everything | Amazing CTO](https://www.amazingcto.com/postgres-for-everything/)

[SQL Maxis: Why We Ditched RabbitMQ and Replaced It with a Postgres Queue | Hacker News](https://news.ycombinator.com/item?id=35526846)
[SQL Maxis: Why We Ditched RabbitMQ And Replaced It With A Postgres Queue](https://www.prequel.co/blog/sql-maxis-why-we-ditched-rabbitmq-and-replaced-it-with-a-postgres-queue)

[Choose Postgres queue technology | Hacker News](https://news.ycombinator.com/item?id=37636841)
[Choose Postgres queue technology :: Adriano Caloiaro's personal blog](https://adriano.fyi/posts/2023-09-24-choose-postgres-queue-technology/)

[Postgres: The next generation | Hacker News](https://news.ycombinator.com/item?id=37832319)
[Postgres: the next generation. Investing in the next generation of committers. - James Governor's Monkchips](https://redmonk.com/jgovernor/2023/10/10/postgres-the-next-generation-investing-in-the-next-generation-of-committers/)

[PostgreSQL is enough | Hacker News](https://news.ycombinator.com/item?id=39273954)
[Postgres is Enough](https://gist.github.com/cpursley/c8fb81fe8a7e5df038158bdfe0f06dbb)

[Postgres as queue | Hacker News](https://news.ycombinator.com/item?id=39315833)
[leontrolski - postgres as queue](https://leontrolski.github.io/postgres-as-queue.html)

[My notes on Gitlab's Postgres schema design (2022) | Hacker News](https://news.ycombinator.com/item?id=39413972)
[My Notes on GitLab Postgres Schema Design - Shekhar Gulati](https://shekhargulati.com/2022/07/08/my-notes-on-gitlabs-postgres-schema-design/)

[I wrote a new JIT compiler for PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=39742916)
[Look ma, I wrote a new JIT compiler for PostgreSQL - Pinaraf's website](https://www.pinaraf.info/2024/03/look-ma-i-wrote-a-new-jit-compiler-for-postgresql/)

[Simon Riggs has died | Hacker News](https://news.ycombinator.com/item?id=39861680)
[Berkubernetus: "PostgreSQL maintainer Simon Riggs has died in a s…" - M6n.io](https://m6n.io/@fuzzychef/112172393647826741)

[Show HN: I open-sourced the in-memory PostgreSQL I built at work for E2E tests | Hacker News](https://news.ycombinator.com/item?id=39960537)
[stackframe-projects/pgmock: In-memory Postgres for unit/E2E tests](https://github.com/stackframe-projects/pgmock)

[Ten years of improvements in PostgreSQL's optimizer | Hacker News](https://news.ycombinator.com/item?id=40060123)
[Ten years of improvements in PostgreSQL's optimizer · Ryan Marcus](https://rmarcus.info/blog/2024/04/12/pg-over-time.html)

[PostgreSQL and UUID as Primary Key | Hacker News](https://news.ycombinator.com/item?id=40884878)
[Maciej Walkowiak | PostgreSQL and UUID as primary key](https://maciejwalkowiak.com/blog/postgres-uuid-primary-key/)

[Dzmitry Plashchynski](https://medium.com/@plashchynski/postgresql-upgrade-on-centos-4c0ddd2f8687)
(2016) PostgreSQL upgrade on CentOS
applicable to all Red Hat family (RHEL/CentOS/SL/OL 7) and to all PostgreSQL 9.* versions.

[Stack Overflow](https://stackoverflow.com/questions/876522/creating-a-copy-of-a-database-in-postgresql)
Creating a copy of a database in PostgreSQL.
in essence, what works for me :
```sql
# backup :
pg_dumpall > db.out
# restore :
# (might requires some DROP DATABASE xxx if you do want to replace existing data with same db and table names)
psql -f db.out postgres
```

[Creating a search engine with PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=36699016)
[Create an advanced search engine with PostgreSQL](https://xata.io/blog/postgres-full-text-search-engine)

## PostgreSQL - downtime

[Fly.io Postgres cluster down for 3 days, no word from them about it | Hacker News](https://news.ycombinator.com/item?id=36808296)
[Service Interruption: Can't Destroy Machine, Deploy, or Restart - Questions / Help - Fly.io](https://web.archive.org/web/20230721130208/https://webcache.googleusercontent.com/search?q=cache:2T9NpG8thZgJ:https://community.fly.io/t/service-interruption-cant-destroy-machine-deploy-or-restart/14227)

[Minimal downtime major PostgreSQL version upgrades with pg_easy_replicate | Hacker News](https://news.ycombinator.com/item?id=36405761)
[shayonj/pg_easy_replicate: Easily setup logical replication and switchover to new database with minimal downtime](https://github.com/shayonj/pg_easy_replicate)

[We migrated our PostgreSQL database with 11 seconds downtime | Hacker News](https://news.ycombinator.com/item?id=39048317)
[How we migrated our PostgreSQL database with 11 seconds downtime - Government Digital Service](https://gds.blog.gov.uk/2024/01/17/how-we-migrated-our-postgresql-database-with-11-seconds-downtime/)

## PostgreSQL - Supabase

[Supabase Edge Functions | Hacker News](https://news.ycombinator.com/item?id=30868849)
[Edge Functions are now available in Supabase](https://supabase.com/blog/supabase-edge-functions)

[Migrating from Supabase | Hacker News](https://news.ycombinator.com/item?id=36004925)
[Migrating from Supabase](https://blog.val.town/blog/migrating-from-supabase/)

[Postgres WASM | Hacker News](https://news.ycombinator.com/item?id=33067962)
[Postgres WASM by Snaplet and Supabase](https://supabase.com/blog/postgres-wasm)

[Postgres Full Text Search vs. the Rest | Hacker News](https://news.ycombinator.com/item?id=33203370)
[Postgres Full Text Search vs the rest](https://supabase.com/blog/postgres-full-text-search-vs-the-rest)

[Supabase Storage now supports the S3 protocol | Hacker News](https://news.ycombinator.com/item?id=40083807)
[Supabase Storage: now supports the S3 protocol](https://supabase.com/blog/s3-compatible-storage)

## PostgreSQL - updates

[Postgres 15 improves UNIQUE and NULL | Hacker News](https://news.ycombinator.com/item?id=32053293)
[Postgres 15 improves UNIQUE and NULL - Blog @ RustProof Labs](https://blog.rustprooflabs.com/2022/07/postgres-15-unique-improvement-with-null)

[PostgreSQL 15 | Hacker News](https://news.ycombinator.com/item?id=33190456)
[PostgreSQL: PostgreSQL 15 Released!](https://www.postgresql.org/about/news/postgresql-15-released-2526/)

[PostgreSQL 14 | Hacker News](https://news.ycombinator.com/item?id=28705699)
[PostgreSQL: PostgreSQL 14 Released!](https://www.postgresql.org/about/news/postgresql-14-released-2318/)

[Waiting for PostgreSQL 14 - SEARCH and CYCLE clauses | Hacker News](https://news.ycombinator.com/item?id=26024719)
[Waiting for PostgreSQL 14 - SEARCH and CYCLE clauses - select * from depesz;](https://www.depesz.com/2021/02/04/waiting-for-postgresql-14-search-and-cycle-clauses/)

[PostgreSQL: No More Vacuum, No More Bloat | Hacker News](https://news.ycombinator.com/item?id=36740921)
[PostgreSQL: No More VACUUM, No More Bloat](https://www.orioledata.com/blog/no-more-vacuum-in-postgresql/)

[Zero downtime Postgres upgrades | Hacker News](https://news.ycombinator.com/item?id=38616181)
[Zero downtime Postgres upgrades | Knock](https://knock.app/blog/zero-downtime-postgres-upgrades)

## PostgreSQL vs Redis

[Do you really need Redis? How to get away with just PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=27482243)
[Do You Need Redis? PostgreSQL Does Queuing, Locking, & Pub/Sub](https://spin.atomicobject.com/redis-postgresql/)

## Redis

[Canceling async Redis command leaves connection open, in unsafe state for future commands · Issue #2665 · redis/redis-py · GitHub](https://github.com/redis/redis-py/issues/2665)

[Kyle Davis: "Welp. It's official. #Redis is…" - Fosstodon](https://fosstodon.org/@linux_mclinuxface/112130466143056921)

[Redis adopts dual source-available licensing | Hacker News](https://news.ycombinator.com/item?id=39772562)
[Redis Adopts Dual Source-Available Licensing | Redis](https://redis.com/blog/redis-adopts-dual-source-available-licensing/)

[The race to replace Redis | Hacker News](https://news.ycombinator.com/item?id=39858144)
[The race to replace Redis [LWN.net]](https://lwn.net/SubscriberLink/966631/6bf2063136effa1e/)

[Four ways to shoot yourself in the foot with Redis](https://old.reddit.com/r/programming/comments/15ctl8m/four_ways_to_shoot_yourself_in_the_foot_with_redis/)

[The End of the Redis Adventure | Hacker News](https://news.ycombinator.com/item?id=23689549)
[The end of the Redis adventure - <antirez>](http://antirez.com/news/133)

[Redis 6.0 GA | Hacker News](https://news.ycombinator.com/item?id=23030685)
[Redis 6.0.0 GA is out! - <antirez>](http://antirez.com/news/132)

## Redis vs SQLite

[Redis re-implemented with SQLite | Hacker News](https://news.ycombinator.com/item?id=40030746)
[nalgeon/redka: Redis re-implemented with SQLite](https://github.com/nalgeon/redka)

## replicated databases

[The leadership myth in replicated databases (2023) | Hacker News](https://news.ycombinator.com/item?id=39281963)
[The Leadership Myth in Replicated Databases | mahesh's blog](https://maheshba.bitbucket.io/blog/2023/05/06/Leadership.html)

## sample databases

[LabelContactRelationYoungerCousinMothersSiblingsDaughterOrFathersSistersDaughter | Hacker News](https://news.ycombinator.com/item?id=37603331)
[CNLabelContactRelationYoungerCousinMothersSiblingsDaughterOrFathersSistersDaughter | Apple Developer Documentation](https://developer.apple.com/documentation/contacts/cnlabelcontactrelationyoungercousinmotherssiblingsdaughterorfatherssistersdaughter)

## schema

[A terrible schema from a clueless programmer | Hacker News](https://news.ycombinator.com/item?id=29139902)
[A terrible schema from a clueless programmer](https://rachelbythebay.com/w/2021/11/06/sql/)

## soft deletion

[Soft deletion probably isn't worth it | Hacker News](https://news.ycombinator.com/item?id=32156009)
[Soft Deletion Probably Isn't Worth It](https://brandur.org/soft-deletion)

## SPARQL

[GitHub - happybeing/SPARQL-endpoints-lists: SPARQL Endpoints Lists and Analysis](https://github.com/happybeing/SPARQL-endpoints-lists)

## spreadsheets - Excel

[Microsoft is bringing Python to Excel | Hacker News](https://news.ycombinator.com/item?id=37222191)
[Microsoft is bringing Python to Excel - The Verge](https://www.theverge.com/2023/8/22/23841167/microsoft-excel-python-integration-support)

[Excel Never Dies | Hacker News](https://news.ycombinator.com/item?id=26386419)
[Excel Never Dies - Not Boring by Packy McCormick](https://www.notboring.co/p/excel-never-dies)

[How did Excel become Turing complete? : computerscience](https://old.reddit.com/r/computerscience/comments/vnmq0h/how_did_excel_become_turing_complete)

[The World Excel Championship is being broadcast on ESPN | Hacker News](https://news.ycombinator.com/item?id=32417534)
[The World Excel Championship is being broadcast on ESPN and it's absolutely wild](https://www.ladbible.com/sport/world-excel-championship-that-is-getting-national-tv-coverage-20220809)

[Excel is pretty dang cool | Hacker News](https://news.ycombinator.com/item?id=32439934)
[Excel is Pretty Dang Cool • Buttondown](https://buttondown.email/hillelwayne/archive/excel-is-pretty-dang-cool/)

[Why do we use R rather than Excel? | Hacker News](https://news.ycombinator.com/item?id=27800291)
["Why do we use R rather than Excel?" - Terence Eden's Blog](https://shkspr.mobi/blog/2021/07/why-do-we-use-r-rather-than-excel/)

[How to sort IP addresses with Excel?: networking](https://www.reddit.com/r/networking/comments/12pmemz/how_to_sort_ip_addresses_with_excel)

[An Excel error led Austria's SPÖ to announce the wrong candidate as the winner | Hacker News](https://news.ycombinator.com/item?id=36197280)
[Jon Stone on X: "incredible story here: Austria's centre-left SPÖ (the country's second largest party) announced the result of its leadership election two days ago... now they say an Excel spreadsheet error led them to announce the wrong candidate as the winner" / X](https://twitter.com/joncstone/status/1665728784366960641)

[My thoughts on Python in Excel | Hacker News](https://news.ycombinator.com/item?id=40656125)
[My thoughts on Python in Excel](https://www.xlwings.org/blog/my-thoughts-on-python-in-excel)

[Excel Power Query @ AskWoody](https://www.askwoody.com/2024/excel-power-query/)

## spreadsheets

[The Tyranny of Spreadsheets | Hacker News](https://news.ycombinator.com/item?id=27923998)
[The Tyranny of Spreadsheets | Tim Harford](https://timharford.com/2021/07/the-tyranny-of-spreadsheets/)

[The pivot table, the spreadsheet's most powerful tool (2020) | Hacker News](https://news.ycombinator.com/item?id=37820877)
[Why pivot tables are the spreadsheet's most powerful tool](https://qz.com/1903322/why-pivot-tables-are-the-spreadsheets-most-powerful-tool)

[Google Sheets ported its calculation worker from JavaScript to WasmGC | Hacker News](https://news.ycombinator.com/item?id=40808820)
[Why Google Sheets ported its calculation worker from JavaScript to WasmGC  |  web.dev](https://web.dev/case-studies/google-sheets-wasmgc)

[SheetHacks: Discover the best tips and tricks for Google Sheets and Excel.](https://sheethacks.com/?App=Excel&Tags=Data&sort_by=Level%3Aasc)

## SQL

[We Can Do Better Than SQL | Hacker News](https://news.ycombinator.com/item?id=19871051)
[We Can Do Better Than SQL | EdgeDB Blog](https://www.edgedb.com/blog/we-can-do-better-than-sql)

[A future for SQL on the web | Hacker News](https://news.ycombinator.com/item?id=28156831)
[A future for SQL on the web](https://jlongster.com/future-sql-web)

[SQL:2023 is finished: Here is what's new | Hacker News](https://news.ycombinator.com/item?id=35562430)
[SQL:2023 is finished: Here is what's new | Peter Eisentraut](https://peter.eisentraut.org/blog/2023/04/04/sql-2023-is-finished-here-is-whats-new)

[Against SQL | Hacker News](https://news.ycombinator.com/item?id=27791539)
[Against SQL](https://www.scattered-thoughts.net/writing/against-sql/)

[Show HN: A SQL database implemented purely in TypeScript type annotations | Hacker News](https://news.ycombinator.com/item?id=24615185)
[codemix/ts-sql: A SQL database implemented purely in TypeScript type annotations.](https://github.com/codemix/ts-sql)

[What ORMs have taught me: just learn SQL (2014) | Hacker News](https://news.ycombinator.com/item?id=21031187)
[What ORMs have taught me: just learn SQL](https://web.archive.org/web/20190920210113/https://wozniak.ca/blog/2014/08/03/What-ORMs-have-taught-me-just-learn-SQL/)

[Semantic Diff for SQL | Hacker News](https://news.ycombinator.com/item?id=32277998)
[GitHub - tobymao/sqlglot: Python SQL Parser and Transpiler](https://github.com/tobymao/sqlglot)
[sqlglot/posts/sql_diff.md at main · tobymao/sqlglot](https://github.com/tobymao/sqlglot/blob/main/posts/sql_diff.md)

[Ask HN: How do you test SQL? | Hacker News](https://news.ycombinator.com/item?id=34602318)

[SQL should be the default choice for data transformation logic | Hacker News](https://news.ycombinator.com/item?id=34578324)
[SQL should be the default choice for data transformation logic](https://www.robinlinacre.com/recommend_sql/)

[D1: Our SQL database | Hacker News](https://news.ycombinator.com/item?id=31339299)
[Announcing D1: our first SQL database](https://blog.cloudflare.com/introducing-d1)

[A single person answered 76k questions about SQL on StackOverflow | Hacker News](https://news.ycombinator.com/item?id=28642326)
[Posts containing 'user:1144035 is:answer' - Stack Overflow](https://stackoverflow.com/search?q=user%3A1144035+%5Bsql%5D+is%3Aanswer&s=668df8e7-e555-48fd-9603-c2451d3e5a2a)

[SQL Shack - articles about database auditing, server performance, data recovery, and more](https://www.sqlshack.com/)

[Show HN: 10 Years to Build a Free SQL Editor | Hacker News](https://news.ycombinator.com/item?id=40562210)
[qStudio Release Version 3.0 » qStudio](https://www.timestored.com/qstudio/release-version-3)

[Brian Peasland](http://www.peasland.net/2016/10/19/slash-or-no-slash/)
(2016) Slash or no Slash in SQL scripts ?

[Vitaliy Mogilevskiy](http://www.dbatoolz.com/t/sqlplus-s-shell-scripting.html)
sqlplus -s Shell Scripting Techniques

[Lukas Eder](https://blog.jooq.org/2017/09/28/10-cool-sql-optimisations-that-do-not-depend-on-the-cost-model/)
(2017) 10 Cool SQL Optimisations That do not Depend on the Cost Model

[Google's new pipe syntax in SQL | Hacker News](https://news.ycombinator.com/item?id=41347188)
[SQL Has Problems. We Can Fix Them: Pipe Syntax In SQL](https://simonwillison.net/2024/Aug/24/pipe-syntax-in-sql/)

## SQLite

[SQLite 3.45 released with JSONB support | Hacker News](https://news.ycombinator.com/item?id=39004963)
[Release History Of SQLite](https://www.sqlite.org/changes.html#version_3_45_0)

[GitHub - jlongster/absurd-sql: sqlite3 in ur indexeddb (hopefully a better backend soon)](https://github.com/jlongster/absurd-sql)

[What if OpenDocument used SQLite? (2014) | Hacker News](https://news.ycombinator.com/item?id=37553574)
[What If OpenDocument Used SQLite?](https://www.sqlite.org/affcase1.html)

[Why SQLite does not use Git (2018) | Hacker News](https://news.ycombinator.com/item?id=36830813)
[Why SQLite Does Not Use Git](https://www.sqlite.org/draft/matrix/whynotgit.html)

[Many small queries are efficient in SQLite | Hacker News](https://news.ycombinator.com/item?id=26151302)
[Many Small Queries Are Efficient In SQLite](https://sqlite.org/np1queryprob.html)

[SQLite in the browser with WASM/JS | Hacker News](https://news.ycombinator.com/item?id=33374402)
[About the sqlite3 WASM/JS Subproject](https://sqlite.org/wasm/doc/tip/about.md)

[Strict Tables - Column type constraints in SQLite - Draft | Hacker News](https://news.ycombinator.com/item?id=28259104)
[STRICT Tables](https://www.sqlite.org/draft/stricttables.html)

[Craziest thing I ever used SQLite for: partial file deduplication (2022) | Hacker News](https://news.ycombinator.com/item?id=35317419)
[SQLite Forum: The craziest thing I ever used SQLite for: partial file deduplication](https://sqlite.org/forum/forumpost/7fecf11e42c71a91?raw)

[I'm all-in on server-side SQLite | Hacker News](https://news.ycombinator.com/item?id=31318708)
[I'm All-In on Server-Side SQLite · The Fly Blog](https://fly.io/blog/all-in-on-sqlite-litestream/)

[I found a bug in SQLite | Hacker News](https://news.ycombinator.com/item?id=33945115)
[How I found a bug in SQLite | Vallified](https://www.philipotoole.com/how-i-found-a-bug-in-sqlite/)
[Vallified Philip O'Toole](https://www.philipotoole.com/)

[Ask HN: Have you used SQLite as a primary database? | Hacker News](https://news.ycombinator.com/item?id=31152490)

[The Winamp Skin Museum is powered by a SQLite3 database with 1.2GB of metadata | Hacker News](https://news.ycombinator.com/item?id=31703874)
[Jordan Eldredge on X: "The Winamp Skin Museum is powered by a sqlite3 database containing 1.2gb of metadata about 86,000 Winamp skins. It's all exposed in this explorable GraphQL endpoint https://t.co/VTW0YVwtQp A bit about the data...🧵 https://t.co/LSJAJtbcC6" / X](https://twitter.com/captbaritone/status/1535471373191028737)

[SQLite is not a toy database | Hacker News](https://news.ycombinator.com/item?id=26580614)
[SQLite is not a toy database](https://antonz.org/sqlite-is-not-a-toy-database/)

[What's New in SQLite 3.35 | Hacker News](https://news.ycombinator.com/item?id=26440397)
[What's new in SQLite 3.35](https://antonz.org/sqlite-3-35/)

[SQLite the only database you will ever need in most cases | Hacker News](https://news.ycombinator.com/item?id=26816954)
[SQLite the only database you will ever need in most cases](https://unixdigest.com/articles/sqlite-the-only-database-you-will-ever-need-in-most-cases.html)

[Show HN: Reduce SQLite database size by up to 80% with transparent compression | Hacker News](https://news.ycombinator.com/item?id=32303762)
[phiresky/sqlite-zstd: Transparent dictionary-based row-level compression for SQLite](https://github.com/phiresky/sqlite-zstd)

[Stranger Strings: An exploitable flaw in SQLite | Hacker News](https://news.ycombinator.com/item?id=33329184)
[Stranger Strings: An exploitable flaw in SQLite | Trail of Bits Blog](https://blog.trailofbits.com/2022/10/25/sqlite-vulnerability-july-2022-library-api/)

[New JSON query operators in SQLite 3.38.0 | Hacker News](https://news.ycombinator.com/item?id=30486052)
[JSON improvements in SQLite 3.38.0](https://tirkarthi.github.io/programming/2022/02/26/sqlite-json-improvements.html)

[Make the "semantic web" web 3.0 again - with the help of SQLite | Hacker News](https://news.ycombinator.com/item?id=29897611)
[ANSIWAVE - Make the "semantic web" web 3.0 again -- with the help of SQLite](https://ansiwave.net/blog/semantic-web.html)

[Using sqlite3 as a notekeeping document graph | Hacker News](https://news.ycombinator.com/item?id=27702084)
[Using sqlite3 as a notekeeping document graph with automatic reference indexing](https://epilys.github.io/bibliothecula/notekeeping.html)

[Why you should probably be using SQLite | Hacker News](https://news.ycombinator.com/item?id=38036921)
[Why you should probably be using SQLite | Epic Web Dev](https://www.epicweb.dev/why-you-should-probably-be-using-sqlite)

[Tracking SQLite Database Changes in Git | Hacker News](https://news.ycombinator.com/item?id=38110286)
[Tracking SQLite Database Changes in Git | Garrit's Notes](https://garrit.xyz/posts/2023-11-01-tracking-sqlite-database-changes-in-git)

[The One Billion Row Challenge | Hacker News](https://news.ycombinator.com/item?id=38851337)
[The One Billion Row Challenge - Gunnar Morling](https://www.morling.dev/blog/one-billion-row-challenge/)
[The One Billion Row Challenge in Go: from 1m45s to 4s in nine solutions | Hacker News](https://news.ycombinator.com/item?id=39578501)
[The One Billion Row Challenge in Go: from 1m45s to 3.4s in nine solutions](https://benhoyt.com/writings/go-1brc/)
[Inserting a billion rows in SQLite under a minute | Hacker News](https://news.ycombinator.com/item?id=27872575)
[Towards Inserting One Billion Rows in SQLite Under A Minute - blag](https://avi.im/blag/2021/fast-sqlite-inserts/)
[Avinash Sajjanshetty](http://avi.im/)

[SQLite: Wal2 Mode | Hacker News](https://news.ycombinator.com/item?id=38988949)
[SQLite: Wal2 Mode Notes](https://www.sqlite.org/cgi/src/doc/wal2/doc/wal2.md)

[Show HN: Static.wiki - read-only Wikipedia using a 43GB SQLite file | Hacker News](https://news.ycombinator.com/item?id=28012829)
[Wikipedia using only static assets & no backend](http://static.wiki/)

[LiteFS | Hacker News](https://news.ycombinator.com/item?id=32925734)
[Introducing LiteFS · The Fly Blog](https://fly.io/blog/introducing-litefs/)

[Why SQLite Uses Bytecode | Hacker News](https://news.ycombinator.com/item?id=40206752)
[Why SQLite Uses Bytecode](https://sqlite.org/draft/whybytecode.html)

[How we sped up Notion in the browser with WASM SQLite | Hacker News](https://news.ycombinator.com/item?id=40949489)
[How we sped up Notion in the browser with WASM SQLite](https://www.notion.so/blog/how-we-sped-up-notion-in-the-browser-with-wasm-sqlite)

[SQLite: 35% Faster Than the Filesystem | Hacker News](https://news.ycombinator.com/item?id=41085376)
[35% Faster Than The Filesystem](https://sqlite.org/fasterthanfs.html)

## SQL - java

[jOOQ Blog](https://blog.jooq.org/)
best practices and lessons learned about writing Java and SQL code

## the importance of knowing databases

[Your database skills are not 'good to have' (2023) | Hacker News](https://news.ycombinator.com/item?id=39892583)
[Your Database Skills Are Not 'Good to Have'](https://renegadeotter.com/2023/11/12/your-database-skills-are-not-good-to-have.html)

## TimescaleDB

[Loading a trillion rows of weather data into TimescaleDB | Hacker News](https://news.ycombinator.com/item?id=40051191)
[Building a weather data warehouse part I: Loading a trillion rows of weather data into TimescaleDB](https://aliramadhan.me/2024/03/31/trillion-rows.html)

## time series database

[Monarch: Google's Planet-Scale In-Memory Time Series Database | Hacker News](https://news.ycombinator.com/item?id=31379383)
[Monarch: Google's Planet-Scale In-Memory Time Series Database](https://www.micahlerner.com/2022/04/24/monarch-googles-planet-scale-in-memory-time-series-database.html)

[Time Series and FoundationDB (2019) | Hacker News](https://news.ycombinator.com/item?id=31540521)
[richardartoul/tsdb-layer: Time Series and FoundationDB. Millions of writes/s and 10x compression in under 2,000 lines of Go.](https://github.com/richardartoul/tsdb-layer)

[GitHub - xephonhq/awesome-time-series-database: A curated list of awesome time series databases, benchmarks and papers](https://github.com/xephonhq/awesome-time-series-database)

[Show HN: Plotting 3 years of hourly data in 150ms | Hacker News](https://news.ycombinator.com/item?id=23045207)
[Time Periods](https://leeoniya.github.io/uPlot/demos/time-periods.html)

[Ntfy.sh - Send push notifications to your phone via PUT/POST | Hacker News](https://news.ycombinator.com/item?id=33517944)
[GitHub - binwiederhier/ntfy: Send push notifications to your phone or desktop using PUT/POST](https://github.com/binwiederhier/ntfy)
[ntfy.sh | Send push notifications to your phone via PUT/POST](https://ntfy.sh/)

## time series database monitoring

[Prometheus Monitoring system & time series database](https://prometheus.io/)

## vector database

[Are we at peak vector database? | Hacker News](https://news.ycombinator.com/item?id=39119198)
[Are we at peak vector database?](https://softwaredoug.com/blog/2024/01/24/are-we-at-peak-vector-db)

[Filtering: The Missing WHERE Clause in Vector Search | Pinecone](https://www.pinecone.io/learn/vector-search-filtering)

[Vector indexing all of Wikipedia on a laptop | Hacker News](https://news.ycombinator.com/item?id=40514266)
[Indexing all of Wikipedia, on a laptop](https://foojay.io/today/indexing-all-of-wikipedia-on-a-laptop/)

## XML

[XML is the future | Hacker News](https://news.ycombinator.com/item?id=36466248)
[XML is the future - Bite code!](https://www.bitecode.dev/p/hype-cycles)

## 0 databases

TeachYourselfCS:
1. UC Berkeley Course: Computer Science 186 (course in Raindrop)
2. Architecture of a Database System (have in PDF)
3. Readings in Database Systems (have in PDF)

[TeachYourselfCS4] [project] we suggest just writing a simple relational database management system from scratch. It will not be feature rich, of course, but even writing the most rudimentary version of every aspect of a typical RDBMS will be illuminating
[TeachYourselfCS5] Data modeling is often neglected:
    Data and Reality: A Timeless Perspective on Perceiving and Managing Information in Our Imprecise World

[Foundations of Databases (1995) | Hacker News](https://news.ycombinator.com/item?id=19726520)
[Foundations of Databases](http://webdam.inria.fr/Alice/)

[The "Build Your Own Database" book is finished | Hacker News](https://news.ycombinator.com/item?id=35666598)
[The "Build Your Own Database" book is finished | Blog | build-your-own.org](https://build-your-own.org/blog/20230420_byodb_done/)

[GitHub - pingcap/awesome-database-learning: A list of learning materials to understand databases internals](https://github.com/pingcap/awesome-database-learning)

[How fucked is my database](http://howfuckedismydatabase.com/)
evaluate how fucked your database is with this handy website.

[GitHub - huachaohuang/awesome-dbdev: Awesome materials about database development.](https://github.com/huachaohuang/awesome-dbdev)

[GitHub - mgramin/awesome-db-tools: Everything that makes working with databases easier](https://github.com/mgramin/awesome-db-tools)

## ACID databases

[ACID Databases - Atomicity, Consistency, Isolation & Durability Explained](https://www.freecodecamp.org/news/acid-databases-explained/)

## relational databases

[How does a relational database work?](http://coding-geek.com/how-databases-work/)

[Relational Database Course - How to Learn SQL in VSCode Using Docker and freeCodeCamp](https://www.freecodecamp.org/news/how-to-run-freecodecamps-relational-databases-curriculum-using-docker-vscode-and-coderoad/)

[Things to know about databases | Hacker News](https://news.ycombinator.com/item?id=31895623)
[Relational Databases Explained](https://architecturenotes.co/things-you-should-know-about-databases/)

## spreadsheets

[How To Use Excel](https://www.how-use-excel.com/)
Excel Tutorial

[Microsoft Excel: 14 Time-Saving Keyboard Shortcuts](https://www.freecodecamp.org/news/microsoft-excel-keyboard-shortcuts/)

## time series database

[GitHub - ElizaLo/Time-Series: Awesome list and projects of Time Series](https://github.com/ElizaLo/Time-Series)

[How can you ensure time-series data quality?](https://www.linkedin.com/comm/advice/3/how-can-you-ensure-time-series-data-quality-iqale)

## vector database

[Vector Databases: A Technical Primer [pdf] | Hacker News](https://news.ycombinator.com/item?id=38971221)
[Vector Databases: A Technical Primer - Vector Databases - A Technical Primer.pdf](https://tge-data-web.nyc3.digitaloceanspaces.com/docs/Vector%20Databases%20-%20A%20Technical%20Primer.pdf)

[What is a Vector Database? (2021) | Hacker News](https://news.ycombinator.com/item?id=35826929)
[What is a Vector Database & How Does it Work? Use Cases + Examples | Pinecone](https://www.pinecone.io/learn/vector-database/)

## 2 data cleaning - data deduplication

[Understanding Data Deduplication | Microsoft Learn](https://learn.microsoft.com/en-us/windows-server/storage/data-deduplication/understand)

## 2 data cleaning

[The Ultimate Guide to Data Cleaning](https://towardsdatascience.com/the-ultimate-guide-to-data-cleaning-3969843991d4)

[Statistics/Data Analysis/Data Cleaning - Wikibooks, open books for an open world](https://en.wikibooks.org/wiki/Statistics/Data_Analysis/Data_Cleaning)

[data organization](https://kbroman.org/dataorg/)
[Save the data in plain text files](https://kbroman.org/dataorg/pages/csv_files.html)

## NoSQL

[What Is NoSQL? NoSQL Databases Explained | MongoDB](https://www.mongodb.com/nosql-explained)

## NoSQL - MongoDB

[MongoDB and Node.js Tutorial - CRUD Operations | MongoDB](https://www.mongodb.com/developer/languages/javascript/node-crud-tutorial/)

[Introduction to MongoDB - MongoDB Manual](https://www.mongodb.com/docs/manual/introduction/)

## PostgreSQL

[PG4E - Postgres for Everybody](https://www.pg4e.com)

[How PostgreSQL stores rows | Hacker News](https://news.ycombinator.com/item?id=30279986)
[How Postgres Stores Rows](https://ketansingh.me/posts/how-postgres-stores-rows/)

[PostgreSQL 14 Internals Book | Hacker News](https://news.ycombinator.com/item?id=32088316)
[PostgreSQL 14 Internals : Postgres Professional](https://postgrespro.com/community/books/internals)

[PostgreSQL Tutorial](https://www.postgresqltutorial.com/)

[Awesome Postgres](https://github.com/dhamaniasad/awesome-postgres)
list of awesome PostgreSQL software, libraries, tools and resources.

## databases

[Database Fundamentals | Hacker News](https://news.ycombinator.com/item?id=38655066)
[Database Fundamentals](https://tontinton.com/posts/database-fundementals/)

[Databasic](http://databasic.io/)
[DataBasic.io](https://databasic.io/en/)
Web tools for beginners that introduce concepts of working with data - free

## SQL

[Database Management Systems and SQL - Tutorial for Beginners](https://www.freecodecamp.org/news/dbms-and-sql-basics)

[Intro to SQL: Querying and managing data | Khan Academy](https://www.khanacademy.org/computing/computer-programming/sql)
[Learn SQL - Online SQL Terminal - Practice SQL Querys](https://www.sql-practice.com/)

## 0 databases

[Things I wished more developers knew about databases | Hacker News](https://news.ycombinator.com/item?id=22942278)
[Things I Wished More Developers Knew About Databases | by Jaana Dogan | Medium](https://rakyll.medium.com/things-i-wished-more-developers-knew-about-databases-2d0178464f78)

[Database Performance at Scale - A free book | Hacker News](https://news.ycombinator.com/item?id=37778069)
[Introducing "Database Performance at Scale": A Free, Open Source Book - ScyllaDB](https://www.scylladb.com/2023/10/02/introducing-database-performance-at-scale-a-free-open-source-book/)

[Show HN: I wrote a free eBook about many lesser-known/secret database tricks | Hacker News](https://news.ycombinator.com/item?id=33833836)
[SQLforDevs.com - Next-Level Database Techniques for Developers Ebook](https://sqlfordevs.com/ebooks/next-level)

## 2 data cleaning

[How to save each line in a text file as new file Stack Overflow](https://stackoverflow.com/questions/30605732/how-to-save-each-line-in-a-text-file-as-new-file)

## big data

[Awesome Big Data](https://github.com/0xnr/awesome-bigdata)
[GitHub - newTendermint/awesome-bigdata: A curated list of awesome big data frameworks, ressources and other awesomeness.](https://github.com/newTendermint/awesome-bigdata)
Big Data Resource Index

## CSV

[GitHub - csvspecs/awesome-csv: Awesome Comma-Separated Values (CSV) - What's Next? - Frequently Asked Questions (F.A.Q.s) - Libraries & Tools](https://github.com/csvspecs/awesome-csv)

## database schema

[Common DB schema change mistakes in Postgres | Hacker News](https://news.ycombinator.com/item?id=40186752)
[Common DB schema change mistakes | Postgres.AI](https://postgres.ai/blog/20220525-common-db-schema-change-mistakes)

## database sharding

[How does database sharding work? | Hacker News](https://news.ycombinator.com/item?id=35476518)
[What is database sharding and how does it work?](https://planetscale.com/blog/what-is-database-sharding-and-how-does-it-work)

[Database “sharding” came from Ultima Online? (2009) | Hacker News](https://news.ycombinator.com/item?id=41351219)
[Database “sharding” came from UO? – Raph's Website](https://www.raphkoster.com/2009/01/08/database-sharding-came-from-uo/)

## data literacy

[A 12-Step Program for Improving Data Literacy - DATAVERSITY](https://www.dataversity.net/a-12-step-program-for-improving-data-literacy/)

## join

[Joins 13 Ways | Hacker News](https://news.ycombinator.com/item?id=36575784)
[Joins 13 Ways](https://justinjaffray.com/joins-13-ways/?a=b)

## NoSQL

[CRUD Operations - What is CRUD?](https://www.freecodecamp.org/news/crud-operations-explained)

## NoSQL - MongoDB

[Using Entity Framework Core with MongoDB](https://www.freecodecamp.org/news/using-entity-framework-core-with-mongodb/)

## ORM

[EF Core with MVC - Overview | ef-core-with-mvc Tutorial](https://riptutorial.com/ef-core-with-mvc/learn/100000/overview)

[EF Core Providers - Getting Started | ef-core-providers Tutorial](https://riptutorial.com/ef-core-providers/learn/100000/getting-started)

[EF 6 + MVC - Overview | ef6-with-mvc Tutorial](https://riptutorial.com/ef6-with-mvc/learn/100000/overview)

[Dapper.NET Tutorial => Getting started with Dapper.NET](https://riptutorial.com/dapper)

[Dapper + MVC - Overview | dapper-with-mvc Tutorial](https://riptutorial.com/dapper-with-mvc/learn/100000/overview)

## PostgreSQL

[Ways to capture changes in Postgres | Hacker News](https://news.ycombinator.com/item?id=37610899)
[All the ways to capture changes in Postgres](https://blog.sequin.io/all-the-ways-to-capture-changes-in-postgres/)
[Sequin: Replicate third-party APIs to Postgres](https://www.sequin.io/)

[Common mistakes in PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=19817531)
[Don't Do This - PostgreSQL wiki](https://wiki.postgresql.org/wiki/Don%27t_Do_This)

[How we upgraded our 4TB Postgres database | Hacker News](https://news.ycombinator.com/item?id=31084147)
[How Retool upgraded our 4 TB main application PostgreSQL database](https://retool.com/blog/how-we-upgraded-postgresql-database)

[How to Manage PostgreSQL Databases from the Command Line with psql](https://www.freecodecamp.org/news/manage-postgresql-with-psql)

[Tips for a Healthier Postgres Database | Hacker News](https://news.ycombinator.com/item?id=29858083)
[Five Tips For a Healthier Postgres Database in... | Crunchy Data Blog](https://www.crunchydata.com/blog/five-tips-for-a-healthier-postgres-database-in-the-new-year)

[Postgres Full-Text Search: A search engine in a database | Hacker News](https://news.ycombinator.com/item?id=27973497)
[Postgres Full-Text Search: A Search Engine in a... | Crunchy Data Blog](https://www.crunchydata.com/blog/postgres-full-text-search-a-search-engine-in-a-database)

[Learn Postgres at the Playground - Postgres compiled to WASM running in browser | Hacker News](https://news.ycombinator.com/item?id=32498435)
[Learn Postgres at the Playground | Crunchy Data Blog](https://www.crunchydata.com/blog/learn-postgres-at-the-playground)

[Lesser-known Postgres features | Hacker News](https://news.ycombinator.com/item?id=29163319)
[Lesser Known PostgreSQL Features | Haki Benita](https://hakibenita.com/postgresql-unknown-features)

[Function pipelines: Building functional programming into PostgreSQL | Hacker News](https://news.ycombinator.com/item?id=28919205)
[Function Pipelines: Building Functional Programming Into PostgreSQL Using Custom Operators](https://www.timescale.com/blog/function-pipelines-building-functional-programming-into-postgresql-using-custom-operators/)

[How We Went All In on sqlc/pgx for Postgres and Go | Hacker News](https://news.ycombinator.com/item?id=28462162)
[How We Went All In on sqlc/pgx for Postgres + Go](https://brandur.org/sqlc)

[Five Easy to Miss PostgreSQL Query Performance Bottlenecks](https://pawelurbanek.com/postgresql-query-bottleneck)

[Securing a Postgres Database | Hacker News](https://news.ycombinator.com/item?id=26674756)
[PostgreSQL Security Hardening](https://goteleport.com/blog/securing-postgres-postgresql/)

[Postgres as a graph database | Hacker News](https://news.ycombinator.com/item?id=35386948)
[Postgres: The Graph Database You Didn't Know You Had](https://www.dylanpaulus.com/posts/postgres-is-a-graph-database/)

[PostgreSQL internals: Things to know about update statements | Hacker News](https://news.ycombinator.com/item?id=38781442)
[PostgreSQL Internals: 3 Things to Know About UPDATE Statements | Patrick's Engineering Blog](https://patrick.engineering/posts/postgres-internals/)

[Ways to shoot yourself in the foot with Postgres | Hacker News](https://news.ycombinator.com/item?id=35684220)
[Nine ways to shoot yourself in the foot with PostgreSQL](https://philbooth.me/blog/nine-ways-to-shoot-yourself-in-the-foot-with-postgresql)

[postgresql Tutorial => Getting started with postgresql](https://riptutorial.com/postgresql)

[How Postgres stores data on disk – this one's a page turner | Hacker News](https://news.ycombinator.com/item?id=41159180)
[How Postgres stores data on disk – this one's a page turner | drew's dev blog](https://drew.silcock.dev/blog/how-postgres-stores-data-on-disk/)
### Disable paging in postgresql

`\pset pager off`

### Connect to a database

`\c database_name`

### Show tables and sequences in current schema

`\d`

### Describe a table

`\d table_name`

### Show only tables with their size (`+`) in current schema

`\dt+`

### Show databases with their privileges and size (`+`) 

`\l+`

### Show available schemas

`\dn`

### Gets the size of a schema

```sql
SELECT pg_size_pretty(SUM(pg_total_relation_size(quote_ident(schemaname) || '.' || quote_ident(tablename)))::BIGINT) FROM pg_tables WHERE schemaname = 'schema_name'
```

### Return back to shell 

`\q`

### List users and their access privileges on databases

`\du`

### List default access privileges

`\ddp`

### List tables, views and sequences with their associated access privileges

`\dp`

### List of roles

`SELECT rolname FROM pg_roles;`

### Detail of a role 

`SELECT * FROM pg_roles WHERE rolname = '...'`

### Which version of PostgreSQL am I running? [src](https://stackoverflow.com/questions/13733719/which-version-of-postgresql-am-i-running)

If you're using CLI and you're a postgres user, then you can do this:
`psql -c "SELECT version();"`

### Creating a copy of a database in PostgreSQL.

```sql
# backup
pg_dumpall > db.out 
# restore 
# (might requires some DROP DATABASE xxx if you do want to replace existing data with same db and table names.
psql -f db.out postgres 
```

## PostgreSQL - Supabase

[Learn Supabase, an Open-Source Firebase Alternative](https://www.freecodecamp.org/news/learn-supabase-open-source-firebase-alternative/)

[Postgres Auditing in 150 lines of SQL | Hacker News](https://news.ycombinator.com/item?id=30615470)
[Postgres Auditing in 150 lines of SQL](https://supabase.com/blog/postgres-audit)

## Redis

[Redis](https://redis.io/)
Key-Value Database
[Introduction to Redis | Redis](https://redis.io/docs/about/)

[Redis explained | Hacker News](https://news.ycombinator.com/item?id=32426879)
[Redis Explained](https://architecturenotes.co/redis/)

[The "Build Your Own Redis" Book Is Completed | Hacker News](https://news.ycombinator.com/item?id=34572263)
[The "Build Your Own Redis" Book is Completed | Blog | build-your-own.org](https://build-your-own.org/blog/20230127_byor/)

[Story: Redis and its creator antirez | Hacker News](https://news.ycombinator.com/item?id=35871462)
[Story: Redis and its creator antirez | Brachiosoft Blog](https://blog.brachiosoft.com/en/posts/redis/)

## relational databases

[David Maier: The Theory of Relational Databases](https://web.cecs.pdx.edu/~maier/TheoryBook/TRD.html)

[Designing a Relational Database and Creating an Entity Relationship Diagram | by Craig Dickson | Towards Data Science](https://towardsdatascience.com/designing-a-relational-database-and-creating-an-entity-relationship-diagram-89c1c19320b2)

## spreadsheets+jsreact

[How to Turn Google Sheets into a REST API and Use it with a React Application](https://www.freecodecamp.org/news/react-and-googlesheets)

## spreadsheets - machine learning

[AI in Google Sheets - How to Use GPT Copilot](https://www.freecodecamp.org/news/ai-in-google-sheets/)

## spreadsheets

[LOOKUP Functions in Google Sheets and Excel - VLOOKUP, XLOOKUP, and More](https://www.freecodecamp.org/news/lookup-functions-in-excel-google-sheets)

[vba Saving a Excel File into .txt format without quotes Stack Overflow](https://stackoverflow.com/questions/11501531/saving-a-excel-file-into-txt-format-without-quotes)

[Export each Row to unique Txt file | MrExcel Message Board](https://www.mrexcel.com/board/threads/export-each-row-to-unique-txt-file.279737)

[List filenames and their properties in an Excel table](https://www.spreadsheet1.com/list-filenames-and-their-properties-in-an-excel-table.html)

[notepad++ Outputting Excel rows to a series of text files Stack Overflow](https://stackoverflow.com/questions/7149539/outputting-excel-rows-to-a-series-of-text-files)

[Convert each row of a spreadsheet into a .txt or .xml file? | MrExcel Message Board](https://www.mrexcel.com/board/threads/convert-each-row-of-a-spreadsheet-into-a-txt-or-xml-file.593439)

[Convert a single Excel file (one text per row) into separate text files. A function in R.](https://gist.github.com/benmarwick/9278490)

[Convert Excel file to Text file](https://python-forum.io/thread-28239.html)

## spreadsheets - python

[How to Automate Excel Tasks with Python](https://www.freecodecamp.org/news/automate-excel-tasks-with-python)

## SQLite+c

[Let's Build a Simple Database (2017) | Hacker News](https://news.ycombinator.com/item?id=19581721)
[Writing a SQLite Clone from Scratch in C (2022) | Hacker News](https://news.ycombinator.com/item?id=35800109)
[How Does a Database Work? | Let's Build a Simple Database](https://cstack.github.io/db_tutorial/)

## SQLite

[How to Corrupt an SQLite Database File | Hacker News](https://news.ycombinator.com/item?id=31214131)
[How To Corrupt An SQLite Database File](https://sqlite.org/howtocorrupt.html)

[How the SQLite virtual machine works | Hacker News](https://news.ycombinator.com/item?id=32750676)
[How the SQLite Virtual Machine Works · The Fly Blog](https://fly.io/blog/sqlite-virtual-machine/)

[Hosting SQLite databases on GitHub Pages or any static file hoster | Hacker News](https://news.ycombinator.com/item?id=27016630)
[Hosting SQLite Databases on GitHub Pages | Hacker News](https://news.ycombinator.com/item?id=28015980)
[Hosting SQLite databases on GitHub Pages - (or IPFS or any static file hoster) - phiresky's blog](https://phiresky.github.io/blog/2021/hosting-sqlite-databases-on-github-pages/)

[How SQLite Helps You Do ACID | Hacker News](https://news.ycombinator.com/item?id=32412905)
[How SQLite helps you do ACID · The Fly Blog](https://fly.io/blog/sqlite-internals-rollback-journal/)

[Turning SQLite into a Distributed Database | Hacker News](https://news.ycombinator.com/item?id=32539360)
[Turning SQLite into a distributed database](https://su3.io/posts/mvsqlite)

[SQLite Internals: Pages and B-trees | Hacker News](https://news.ycombinator.com/item?id=32250426)
[SQLite Internals: Pages & B-trees · The Fly Blog](https://fly.io/blog/sqlite-internals-btree/)

[Show HN: Google Drive to SQLite | Hacker News](https://news.ycombinator.com/item?id=30417411)
[Google Drive to SQLite](https://simonwillison.net/2022/Feb/20/google-drive-to-sqlite/)

[sqlite Tutorial => Getting started with sqlite](https://riptutorial.com/sqlite)

## SQL

[Best practices for writing SQL queries | Hacker News](https://news.ycombinator.com/item?id=26762206)
[Best practices for writing SQL queries](https://www.metabase.com/learn/sql-questions/sql-best-practices)

[The Ultimate Guide to SQL Join Statements: Left, Right, Inner, Outer](https://www.freecodecamp.org/news/the-ultimate-guide-to-sql-join-statements)

[SQL Joins Tutorial: Cross Join, Full Outer Join, Inner Join, Left Join, and Right Join.](https://www.freecodecamp.org/news/sql-joins-tutorial)

[For Want of a JOIN | Hacker News](https://news.ycombinator.com/item?id=34092645)
[For Want of a JOIN](https://www.moderndescartes.com/essays/sql_join/)

[SQL Operators Tutorial - Bitwise, Comparison, Arithmetic, and Logical Operator Query Examples](https://www.freecodecamp.org/news/sql-operators-tutorial)

[Searching & Exploring Your iMessage Database with SQL Queries](https://spin.atomicobject.com/2020/05/22/search-imessage-sql/)

[Lukas Eder](https://blog.jooq.org/2017/01/12/a-probably-incomplete-comprehensive-guide-to-the-many-different-ways-to-join-tables-in-sql/)
(2017) A Probably Incomplete, Comprehensive Guide to the Many Different Ways to JOIN Tables in SQL

## time series database - machine learning

[GitHub - qingsongedu/time-series-transformers-review: A professionally curated list of awesome resources (paper, code, data, etc.) on transformers in time series.](https://github.com/qingsongedu/time-series-transformers-review)

[GitHub - qingsongedu/awesome-AI-for-time-series-papers: A professional list of Papers, Tutorials, and Surveys on AI for Time Series in top AI conferences and journals.](https://github.com/qingsongedu/awesome-AI-for-time-series-papers)

## time series database

[Write a time-series database engine from scratch | Hacker News](https://news.ycombinator.com/item?id=27730854)
[Ryo Nakao](https://nakabonne.dev/posts/write-tsdb-from-scratch/)

[GitHub - mark-rushakoff/awesome-influxdb: A curated list of awesome projects, libraries, tools, etc. related to InfluxDB](https://github.com/mark-rushakoff/awesome-influxdb)
[InfluxDB Time Series Data Platform | InfluxData](https://www.influxdata.com/)

## time series database monitoring

[Overview | Prometheus](https://prometheus.io/docs/introduction/overview/)

[GitHub - roaldnefs/awesome-prometheus: A curated list of awesome Prometheus resources, projects and tools.](https://github.com/roaldnefs/awesome-prometheus)

[GitHub frutik/awesome-timeseries: Forecasting, anomaly detection, predictive analytics, econometrics and much more](https://github.com/frutik/awesome-timeseries)

## vector database

[Locality Sensitive Hashing (LSH): The Illustrated Guide | Pinecone](https://www.pinecone.io/learn/locality-sensitive-hashing)
[Nearest Neighbor Indexes for Similarity Search | Pinecone](https://www.pinecone.io/learn/vector-indexes)

## XML

[How to dig into Excel files using the Office XML file format @ AskWoody](https://www.askwoody.com/2024/how-to-dig-into-excel-files-using-the-office-xml-file-format/)

## MySQL

[MySQL for Developers | Hacker News](https://news.ycombinator.com/item?id=35247242)
[MySQL for Developers course: MySQL for Developers - PlanetScale](https://planetscale.com/learn/courses/mysql-for-developers/introduction/course-introduction)

[MySQL Tutorial](https://www.mysqltutorial.org/)

[MySQL Tutorial => Getting started with MySQL](https://riptutorial.com/mysql)

[GitHub - shlomi-noach/awesome-mysql: A curated list of awesome MySQL software, libraries, tools and resources](https://github.com/shlomi-noach/awesome-mysql)

## SQL

[Basic SQL Commands - The List of Database Queries and Statements You Should Know](https://www.freecodecamp.org/news/basic-sql-commands)

[What is SQL? What is a Database? Relational Database Management Systems (RDBMS) Explained in Plain English.](https://www.freecodecamp.org/news/sql-and-databases-explained-in-plain-english)

[SQL Murder Mystery | Hacker News](https://news.ycombinator.com/item?id=21799988)
[The SQL Murder Mystery](https://mystery.knightlab.com/)

[Show HN: I made a SQL game to help people learn/challenge their skills | Hacker News](https://news.ycombinator.com/item?id=35665142)
[Lost at SQL - SQL learning game](https://lost-at-sql.therobinlord.com/)

[SQLBolt - Learn SQL - Introduction to SQL](https://sqlbolt.com/)

[Mastery with SQL](https://www.masterywithsql.com/)

[Learn SQL | Codecademy](https://www.codecademy.com/learn/learn-sql)

[Learn SQL Online | SQL Courses, Tracks, and Resources | DataCamp](https://www.datacamp.com/learn/sql)

[SQL for data scientists in 100 queries | Hacker News](https://news.ycombinator.com/item?id=39281178)
[The Querynomicon](https://gvwilson.github.io/sql-tutorial/)

[SQLtutor - Summary [Savannah]🆓](https://savannah.gnu.org/projects/sqltutor)

[Practical SQL for Data Analysis | Hacker News](https://news.ycombinator.com/item?id=27025829)
[Practical SQL for Data Analysis | Haki Benita](https://hakibenita.com/sql-for-data-analysis)

[SQL Tutorial => Getting started with SQL](https://riptutorial.com/sql)

## SQLite

[The SQLite Code of Ethics | Hacker News](https://news.ycombinator.com/item?id=31886687)
[Code Of Ethics](https://sqlite.org/codeofethics.html)

[How to Work with SQLite in Python – A Handbook for Beginners](https://www.freecodecamp.org/news/work-with-sqlite-in-python-handbook/)

## SQL Server

[Microsoft SQL Server Tutorial => Getting started with Microsoft SQL...](https://riptutorial.com/sql-server)