[[
wikihub
]]
Search
⌘K
Explore
People
For Agents
Sign in
Explore
People
For Agents
Sign in
@harrisonqian / Awesome / wiki/databases/database-tools.md
Suggest edit
Cancel
Submit suggestion
Title
Name
Note
--- visibility: public --- # Database Tools **repo:** [mgramin/awesome-db-tools](https://github.com/mgramin/awesome-db-tools) **category:** [[databases|Databases]] **related:** [[database|Database]] --- # Awesome Database Tools [](https://awesome.re) > Community driven list of database tools Here we will collect information about awesome useful and awesome experimental tools that simplify working with databases for DBA, DevOps, Developers and mere mortals. Feel free to add information about your own db-tools or your favorite third-party db-tools. For updates on `awesome-db-tools` and thoughts/news about databases/tools/SQL follow me at [@GraminMaksim](https://twitter.com/GraminMaksim) ## Contents - [IDE](#ide) - [GUI](#gui) - [CLI](#cli) - [Schema](#schema) - [Changes](#changes) - [Code generation](#code-generation) - [Diagrams](#diagrams) - [Documentations](#documentations) - [Design](#design) - [Samples](#samples) - [API](#api) - [Application platforms](#application-platforms) - [Backup](#backup) - [Cloning](#cloning) - [Monitoring/Statistics/Perfomance](#monitoringstatisticsperfomance) - [Prometheus](#prometheus) - [Zabbix](#zabbix) - [Testing](#testing) - [HA/Failover/Sharding](#hafailoversharding) - [Kubernetes](#kubernetes) - [Configuration Tuning](#configuration-tuning) - [DevOps](#devops) - [Reporting](#reporting) - [Distributions](#distributions) - [Security](#security) - [SQL](#sql) - [Analyzers](#analyzers) - [Extensions](#extensions) - [Frameworks](#frameworks) - [Formatters](#formatters) - [Games](#games) - [Parsers](#parsers) - [Über SQL](#über-sql) - [Language Server Protocol](#language-server-protocol) - [Learning](#learning) - [Plan](#plan) - [Scripts](#scripts) - [Data](#data) - [Catalog](#catalog) - [Lineage](#lineage) - [Generation/Masking/Subsetting](#generationmaskingsubsetting) - [Data Profilers](#data-profilers) - [Replication](#replication) - [Compare](#compare) - [Papers](#papers) - [Machine Learning](#machine-learning) ## IDE - [AnySQL Maestro](https://www.sqlmaestro.com/products/anysql/maestro) - Premier multi-purpose admin tool for [database](/@harrisonqian/awesome/wiki/databases/database) management, control and development. - [Aqua Data Studio](https://www.aquafold.com/aquadatastudio) - [Productivity](/@harrisonqian/awesome/wiki/work/productivity) software for [Database](/@harrisonqian/awesome/wiki/databases/database) Developers, DBAs, and Analysts. - [Coginiti Pro](https://www.coginiti.co/products/coginiti-pro/) - Modern IDE for analyst and [analytics](/@harrisonqian/awesome/wiki/miscellaneous/analytics) engineers with proweful script and grid functionality. - [Database .net](http://fishcodelib.com/Database.htm) - Multiple [database](/@harrisonqian/awesome/wiki/databases/database) management tool with support for 20+ databases. - [Database Workbench](https://www.upscene.com/database_workbench/) - Complete IDE for [database](/@harrisonqian/awesome/wiki/databases/database) design, development and [testing](/@harrisonqian/awesome/wiki/testing/testing) for Oracle, SQL Server, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, Firebird, InterBase, SQLite and NexusDB. - [DataGrip](https://www.jetbrains.com/datagrip) - [Cross-Platform](/@harrisonqian/awesome/wiki/platforms/cross-platform) IDE for Databases & SQL by JetBrains. - [DataStation](https://github.com/multiprocessio/datastation) - Easily query, script, and visualize data from every [database](/@harrisonqian/awesome/wiki/databases/database), file, and API. - [DBeaver](https://github.com/dbeaver/dbeaver) - Free universal [database](/@harrisonqian/awesome/wiki/databases/database) manager and SQL client. - [dbForge Edge](https://www.devart.com/dbforge/edge/) - Multidatabase solution for DB development, design, management, and administration of [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, SQL Server, Oracle, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) databases, and various cloud services. - [dbForge Studio for MySQL](https://www.devart.com/dbforge/mysql/studio) - Universal IDE for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and MariaDB [database](/@harrisonqian/awesome/wiki/databases/database) development, management, and administration. - [dbForge Studio for Oracle](https://www.devart.com/dbforge/oracle/studio) - Powerful IDE for Oracle management, administration, and development. - [dbForge Studio for PostgreSQL](https://www.devart.com/dbforge/postgresql/studio) - GUI tool for managing and developing databases and objects. - [dbForge Studio for SQL Server](https://www.devart.com/dbforge/sql/studio) - Powerful integrated development environment for SQL Server development, management, administration, data analysis, and reporting. - [DBHawk](https://www.datasparc.com/) - Datasparc offers [database](/@harrisonqian/awesome/wiki/databases/database) [security](/@harrisonqian/awesome/wiki/security/security), [database](/@harrisonqian/awesome/wiki/databases/database) management, database governance and data [analytics](/@harrisonqian/awesome/wiki/miscellaneous/analytics) - all in one solution. - [dbKoda](https://github.com/SouthbankSoftware/dbkoda) - Modern (JavaScript/Electron framework), open source IDE for [MongoDB](/@harrisonqian/awesome/wiki/databases/mongodb). It has features to support development, administration and performance tuning on [MongoDB](/@harrisonqian/awesome/wiki/databases/mongodb) databases. - [IBExpert](http://www.ibexpert.net/ibe) - Comprehensive GUI tool for Firebird and InterBase. - [HeidiSQL](https://github.com/HeidiSQL/HeidiSQL) - A lightweight client for managing [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MSSQL and [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), written in Delphi. - [Kangaroo](https://github.com/dbkangaroo/kangaroo) - A AI-powered SQL client and admin tool for popular databases(SQLite / [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) / [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) / etc) on [Windows](/@harrisonqian/awesome/wiki/platforms/windows) / macOS / [Linux](/@harrisonqian/awesome/wiki/platforms/linux), support table design, query, model, sync, export/import etc, focus on comfortable, fun and developer friendly. - [KeepTool](https://keeptool.com) - A professional suite of tools for Oracle [Database](/@harrisonqian/awesome/wiki/databases/database) developers, administrators and advanced application users. - [MySQL Workbench](https://www.[mysql](/@harrisonqian/awesome/wiki/databases/mysql).com/products/workbench) - Unified visual tool for [database](/@harrisonqian/awesome/wiki/databases/database) architects, developers, and DBAs. - [Navicat](https://www.navicat.com/en/products#navicat) - A [database](/@harrisonqian/awesome/wiki/databases/database) development tool that allows you to simultaneously connect to [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, SQL Server, Oracle, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), and SQLite databases from a single application. - [Oracle SQL Developer](http://www.oracle.com/technetwork/developer-tools/sql-developer) - Free, integrated development environment that simplifies the development and management of Oracle [Database](/@harrisonqian/awesome/wiki/databases/database) in both traditional and Cloud deployments. - [pgAdmin](https://www.pgadmin.org) - The most popular and feature rich Open Source administration and development platform for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), the most advanced Open Source [database](/@harrisonqian/awesome/wiki/databases/database) in the world. - [pgAdmin3](https://www.bigsql.org/pgadmin3) - Long Term Support for pgAdmin3. - [PL/SQL Developer](https://www.allroundautomations.com/products/pl-sql-developer) - IDE that is specifically targeted at the development of stored program units for Oracle Databases. - [PostgreSQL Maestro](https://www.sqlmaestro.com/products/postgresql/maestro) - Complete and powerful [database](/@harrisonqian/awesome/wiki/databases/database) management, admin and development tool for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Querybook](https://github.com/pinterest/querybook) - Pinterest open-source [Big Data](/@harrisonqian/awesome/wiki/big-data/big-data) Querying UI, combining collocated table metadata and a simple notebook IDE interface. - [Slashbase](https://github.com/slashbaseide/slashbase) - The open-source collaborative IDE for your databases. Connect to your [database](/@harrisonqian/awesome/wiki/databases/database), browse data, run a bunch of SQL commands or share SQL queries with your team, right from your browser. - [Sql Server Management Studio](https://docs.microsoft.com/en-us/sql/ssms/sql-server-management-studio-ssms) - Integrated environment for managing any SQL infrastructure, for SQL Server and Azure SQL Databases. - [Toad](https://www.quest.com/toad/) - Premier [database](/@harrisonqian/awesome/wiki/databases/database) solution for developers, admins and data analysts. Manage complex database changes with a single database management tool. - [Toad Edge](https://www.toadworld.com/products/toad-edge) - Simplified [database](/@harrisonqian/awesome/wiki/databases/database) development tool for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [TOra](https://github.com/tora-tool/tora) - Open source SQL IDE for Oracle, [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) dbs. - [Valentina Studio](https://www.valentina-db.com/en/valentina-studio-overview) - Create, administer, query and explore Valentina DB, [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) and SQLite databases for FREE. - [WebDB](https://webdb.app) - Free Efficient [Database](/@harrisonqian/awesome/wiki/databases/database) IDE. Featuring Server Discovery, ERD, Data Generator, AI, NoSQL Structure Manager, Database Versioning and many more. ## GUI - [Adminer](https://github.com/vrana/adminer) - [Database](/@harrisonqian/awesome/wiki/databases/database) management in a single PHP file. - [Another Redis Desktop Manager](https://github.com/qishibo/AnotherRedisDesktopManager) - Free Open Source Redis Manager. Available on Mac, [Linux](/@harrisonqian/awesome/wiki/platforms/linux), [Windows](/@harrisonqian/awesome/wiki/platforms/windows), Homebrew, Snap, winget, and more. - [Antares SQL](https://github.com/antares-sql/antares) - A modern, fast and [productivity](/@harrisonqian/awesome/wiki/work/productivity) driven SQL client with a focus in UX. Available for Mac, [Linux](/@harrisonqian/awesome/wiki/platforms/linux) and [Windows](/@harrisonqian/awesome/wiki/platforms/windows). - [Azure Data Studio](https://github.com/microsoft/azuredatastudio) - A data management tool that enables working with SQL Server, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), Azure SQL DB and SQL DW from [Windows](/@harrisonqian/awesome/wiki/platforms/windows), macOS and [Linux](/@harrisonqian/awesome/wiki/platforms/linux). - [Beekeeper Studio](https://github.com/beekeeper-studio/beekeeper-studio) - Open Source SQL Editor and [Database](/@harrisonqian/awesome/wiki/databases/database) Manager with a privacy commitment in their mission statement. - [Clidey WhoDB](https://github.com/clidey/whodb) - A lightweight [database](/@harrisonqian/awesome/wiki/databases/database) explorer with next-gen UX for all SQL, NoSQL, Caches, and Queues. - [DbGate](https://github.com/dbgate/dbgate) - [Database](/@harrisonqian/awesome/wiki/databases/database) manager for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), SQL Server, [MongoDB](/@harrisonqian/awesome/wiki/databases/mongodb), SQLite and others. Runs under [Windows](/@harrisonqian/awesome/wiki/platforms/windows), [Linux](/@harrisonqian/awesome/wiki/platforms/linux), Mac or as web application. - [DB Lens](https://github.com/dblens/app) - Open Source [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) GUI - Automatic ER diagrams, Internal DB Insights, Disk Utilisation, Performance Metrics, Index Usage, Sequential scan counts and more. - [DbVisualizer](https://www.dbvis.com) - Universal [database](/@harrisonqian/awesome/wiki/databases/database) tool for developers, DBAs and analysts. - [JackDB](https://www.jackdb.com) - Direct SQL access to all your data, no matter where it lives. - [Jailer](https://github.com/Wisser/Jailer) - [Database](/@harrisonqian/awesome/wiki/databases/database) Subsetting and Relational Data Browsing Tool/Client. - [Malewicz](https://github.com/mgramin/malewicz) - Yet Another WEB client for DB schema exploring and performance analysis, but originally created specifically for [hacking](/@harrisonqian/awesome/wiki/security/hacking) and extending. - [MissionKontrol](https://www.missionkontrol.io) - Modern drag & drop admin panel/client with full user permissions for non-technical users. - [ocelotgui](https://github.com/ocelot-inc/ocelotgui) - For [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, and Tarantool. Developed for [Linux](/@harrisonqian/awesome/wiki/platforms/linux) but can run on [Windows](/@harrisonqian/awesome/wiki/platforms/windows). - [OmniDB](https://github.com/OmniDB/OmniDB) - Web tool for [database](/@harrisonqian/awesome/wiki/databases/database) management. - [Pgweb](https://github.com/sosedoff/pgweb) - Web-based [database](/@harrisonqian/awesome/wiki/databases/database) browser for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), written in Go and works on macOS, [Linux](/@harrisonqian/awesome/wiki/platforms/linux) and [Windows](/@harrisonqian/awesome/wiki/platforms/windows) machines. - [phpLiteAdmin](https://www.phpliteadmin.org) - Web-based SQLite [database](/@harrisonqian/awesome/wiki/databases/database) admin tool written in PHP with support for SQLite3 and SQLite2. - [phpMyAdmin](https://github.com/phpmyadmin/phpmyadmin) - A web interface for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and MariaDB. - [psequel](http://www.psequel.com) - Provides a clean and simple interface for you to perform common [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) tasks quickly. - [PopSQL](https://popsql.com) - Modern, collaborative SQL editor for your team. - [Postico](https://eggerapps.at/postico) - A Modern [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Client for the Mac. - [Robo 3T](https://github.com/Studio3T/robomongo) - [Shell](/@harrisonqian/awesome/wiki/development-environment/shell)-centric [cross-platform](/@harrisonqian/awesome/wiki/platforms/cross-platform) [MongoDB](/@harrisonqian/awesome/wiki/databases/mongodb) management tool. - [Sequel Ace](https://github.com/Sequel-Ace/Sequel-Ace) - [MySQL](/@harrisonqian/awesome/wiki/databases/mysql)/MariaDB [database](/@harrisonqian/awesome/wiki/databases/database) management for macOS. - [Sequel Pro](https://github.com/sequelpro/sequelpro) - Fast, easy-to-use Mac [database](/@harrisonqian/awesome/wiki/databases/database) management application for working with [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) & MariaDB databases. - [SQLite Expert](http://www.sqliteexpert.com/index.html) - Graphical interface supports all SQLite features. - [sqlite-tui](https://github.com/mathaou/sqlite-tui) - A TUI for viewing SQLite databases, written in Go. - [sqlpad](https://github.com/rickbergfalk/sqlpad) - Web-based SQL editor run in your own private cloud. - [SQLPro](https://www.macpostgresclient.com) - A simple, powerful [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) manager for macOS. - [SQuirreL](https://sourceforge.net/projects/squirrel-sql) - Graphical SQL client written in [Java](/@harrisonqian/awesome/wiki/programming-languages/java) that will allow you to view the structure of a JDBC compliant [database](/@harrisonqian/awesome/wiki/databases/database), browse the data in tables, issue SQL commands etc. - [SQLTools](https://github.com/mtxr/vscode-sqltools) - [Database](/@harrisonqian/awesome/wiki/databases/database) management for VSCode. - [SQLyog](https://www.webyog.com/product/sqlyog) - The most complete and easy to use [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) GUI. - [Tabix](https://github.com/tabixio/tabix) - SQL Editor & Open source simple business intelligence for Clickhouse. - [TablePlus](https://github.com/TablePlus/TablePlus) - Modern, native, and friendly GUI tool for relational databases: [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), SQLite & more. - [TeamPostgreSQL](http://www.teampostgresql.com) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Web Administration GUI - use your [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) databases from anywhere, with rich, lightning-fast AJAX web interface. - [Query.me](https://query.me) - Collaborative SQL editor in Notebook format. Let's you reference query results using JINJA, visualize data, and schedule runs and exports. ## CLI - [ipython-sql](https://github.com/catherinedevlin/ipython-sql) - Connect to a [database](/@harrisonqian/awesome/wiki/databases/database) for issue SQL commands within IPython or IPython Notebook. - [iredis](https://github.com/laixintao/iredis) - A Cli for Redis with AutoCompletion and Syntax Highlighting. - [pgcenter](https://github.com/lesovsky/pgcenter) - Top-like admin tool for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [pg_activity](https://github.com/julmon/pg_activity) - Top-like application for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) server activity monitoring. - [pg_top](https://github.com/markwkm/pg_top) - Top for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [pspg](https://github.com/okbob/pspg) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Pager. - [SQLcl](http://www.oracle.com/technetwork/developer-tools/sqlcl/overview/index.html) - Oracle SQL Developer Command Line (SQLcl) is a free command line interface for Oracle [Database](/@harrisonqian/awesome/wiki/databases/database). - [sqlite-utils](https://github.com/simonw/sqlite-utils) - CLI tools for manipulating SQLite [database](/@harrisonqian/awesome/wiki/databases/database) files - inserting data, running queries, creating indexes, configuring full-text search and more. - [SQLLine](https://github.com/julianhyde/sqlline) - Command-line [shell](/@harrisonqian/awesome/wiki/development-environment/shell) for issuing SQL to relational databases via JDBC. - [usql](https://github.com/xo/usql) - A universal command-line interface for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), Oracle [Database](/@harrisonqian/awesome/wiki/databases/database), SQLite3, Microsoft SQL Server, and many other databases including NoSQL and non-relational databases! ### dbcli - [athenacli](https://github.com/dbcli/athenacli) - CLI tool for AWS Athena service that can do auto-completion and syntax highlighting. - [litecli](https://github.com/dbcli/litecli) - CLI for SQLite Databases with auto-completion and syntax highlighting. - [mssql-cli](https://github.com/dbcli/mssql-cli) - A command-line client for SQL Server with auto-completion and syntax highlighting. - [mycli](https://github.com/dbcli/mycli) - A Terminal Client for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) with AutoCompletion and Syntax Highlighting. - [pgcli](https://github.com/dbcli/pgcli) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) CLI with autocompletion and syntax highlighting. - [vcli](https://github.com/dbcli/vcli) - Vertica CLI with auto-completion and syntax highlighting. ## Schema ### Changes - [2bass](https://github.com/CourseOrchestra/2bass) - [Database](/@harrisonqian/awesome/wiki/databases/database) configuration-as-code tool that utilizes concept of idempotent DDL scripts. - [Atlas](https://github.com/ariga/atlas) - Inspect and Apply changes to your [database](/@harrisonqian/awesome/wiki/databases/database) schema. - [Bytebase](https://github.com/bytebase/bytebase) - Web-based, zero-config, dependency-free [database](/@harrisonqian/awesome/wiki/databases/database) schema change and version control tool for teams. - [flyway](https://github.com/flyway/flyway) - [Database](/@harrisonqian/awesome/wiki/databases/database) migration tool. - [gh-ost](https://github.com/github/gh-ost) - Online schema migration for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql). - [liquibase](https://github.com/liquibase/liquibase) - [Database](/@harrisonqian/awesome/wiki/databases/database)-independent library for tracking, managing and applying database schema changes. - [migra](https://github.com/djrobstep/migra) - Like diff but for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) schemas. - [node-pg-migrate](https://github.com/salsita/node-pg-migrate) - [Node.js](/@harrisonqian/awesome/wiki/platforms/node-js) [database](/@harrisonqian/awesome/wiki/databases/database) migration management built exclusively for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). (But can also be used for other DBs conforming to SQL standard - e.g. CockroachDB.) - [pg-osc](https://github.com/shayonj/pg-osc) - Easy CLI tool for making zero downtime schema changes and backfills in [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Prisma Migrate](https://github.com/prisma/migrate) - Declarative [database](/@harrisonqian/awesome/wiki/databases/database) schema migration tool that uses a declarative data modeling syntax to describe your database schema. - [Pyrseas](https://github.com/perseas/Pyrseas) - Provides utilities to describe a [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database) schema as YAML. - [Reshape](https://github.com/fabianlindfors/reshape) - An easy-to-use, zero-downtime schema migration tool for Postgres. - [SchemaHero](https://github.com/schemahero/schemahero) - A [Kubernetes](/@harrisonqian/awesome/wiki/back-end-development/kubernetes) operator for declarative [database](/@harrisonqian/awesome/wiki/databases/database) schema management (gitops for database schemas). - [Skeema](https://github.com/skeema/skeema) - Declarative pure-SQL schema management system for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and MariaDB, with support for sharding and external online schema change tools. - [Sqitch](https://github.com/sqitchers/sqitch) - Sensible [database](/@harrisonqian/awesome/wiki/databases/database)-native change management for framework-free development and dependable deployment. - [sqldef](https://github.com/k0kubun/sqldef) - Idempotent schema management for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), and more. - [yuniql](https://github.com/rdagumampan/yuniql) - Yet another schema versioning and migration tool just made with native .NET [Core](/@harrisonqian/awesome/wiki/platforms/core) 3.0+ and hopefully better. ### Code generation - [ddl-generator](https://github.com/catherinedevlin/ddl-generator) - Infers SQL DDL (Data Definition Language) from table data. - [scheme2ddl](https://github.com/qwazer/scheme2ddl) - Command line util for export Oracle schema to set of ddl init scripts with ability to filter undesirable information, separate DDL in different files, pretty format output. ### Diagrams - [Azimutt](https://github.com/azimuttapp/azimutt) - An Entity Relationship diagram (ERD) visualization tool, with various filters and inputs to help understand your [database](/@harrisonqian/awesome/wiki/databases/database) schema. - [ChartDB](https://github.com/chartdb/chartdb) - Free and Open-source [database](/@harrisonqian/awesome/wiki/databases/database) diagrams editor, visualize and design your DB with a single query. - [DrawDB](https://github.com/drawdb-io/drawdb) - Free, simple, and intuitive online [database](/@harrisonqian/awesome/wiki/databases/database) design tool and SQL generator. - [ERAlchemy](https://github.com/Alexis-benoist/eralchemy) - Entity Relation Diagrams generation tool. - [ERD Lab](https://www.erdlab.io/) - Free cloud based entity relationship diagram (ERD) tool made for developers. - [Liam ERD](https://github.com/liam-hq/liam) - Open-source tool that generates beautiful and easy-to-read Entity Relationship Diagrams from your [database](/@harrisonqian/awesome/wiki/databases/database) and ORMs. - [QuickDBD](https://www.quickdatabasediagrams.com/) - Simple online tool to quickly draw [database](/@harrisonqian/awesome/wiki/databases/database) diagrams. ### Documentations - [dbdocs](https://dbdocs.io/) - Create web-based [database](/@harrisonqian/awesome/wiki/databases/database) documentation using DSL code. - [DBML](https://github.com/holistics/dbml) - [Database](/@harrisonqian/awesome/wiki/databases/database) Markup Language, designed to define and document database structures. - [SchemaCrawler](https://github.com/schemacrawler/SchemaCrawler) - A free [database](/@harrisonqian/awesome/wiki/databases/database) schema discovery and comprehension tool. - [Schema Spy](https://github.com/schemaspy/schemaspy) - Generating your [database](/@harrisonqian/awesome/wiki/databases/database) to HTML documentation, including Entity Relationship diagrams. - [tbls](https://github.com/k1LoW/tbls) - CI-Friendly tool for document a [database](/@harrisonqian/awesome/wiki/databases/database), written in Go. ### Design - [Database Design](https://github.com/alextanhongpin/database-design) - Useful [tips](/@harrisonqian/awesome/wiki/programming-languages/tips) for designing robust [database](/@harrisonqian/awesome/wiki/databases/database) schema. - [DBDiagram](https://dbdiagram.io) - A free, simple tool to draw ER diagrams by just writing code. - [DbSchema](https://dbschema.com/) - Universal [database](/@harrisonqian/awesome/wiki/databases/database) designer for out-of-the-box schema management, schema documentation, design in a team, and deployment on multiple databases. DbSchema features tools for writing and executing queries, exploring the data, generating data, and building reports. - [ERBuilder Data Modeler](https://soft-builder.com/erbuilder-data-modeler) - Easy-to-use [database](/@harrisonqian/awesome/wiki/databases/database) modeling software for high-quality data models. It's a complete data modeling solution for data modelers and data architects. - [Moon Modeler](https://www.datensen.com) - Data modeling tool for both noSQL and relational databases. Available for [Windows](/@harrisonqian/awesome/wiki/platforms/windows), [Linux](/@harrisonqian/awesome/wiki/platforms/linux) and macOS. - [Navicat Data Modeler](https://www.navicat.com/en/products/navicat-data-modeler) - A powerful and cost-effective [database](/@harrisonqian/awesome/wiki/databases/database) design tool which helps you build high-quality conceptual, logical and physical data models. - [Oracle SQL Developer Data Modeler](http://www.oracle.com/technetwork/developer-tools/datamodeler/overview/index.html) - Free graphical tool that enhances [productivity](/@harrisonqian/awesome/wiki/work/productivity) and simplifies data modeling tasks. - [pgmodeler](https://github.com/pgmodeler/pgmodeler) - Data modeling tool designed for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [WWW SQL Designer](https://github.com/ondras/wwwsqldesigner) - Online SQL diagramming tool. ### Samples - [Oracle [Database](/@harrisonqian/awesome/wiki/databases/database) Sample Schemas](https://github.com/oracle/db-sample-schemas) - Sample schemas for Oracle Database. ## API Building API for your Data - [Datasette](https://github.com/simonw/datasette) - A tool for exploring and publishing data. - [DreamFactory](https://github.com/dreamfactorysoftware/dreamfactory) - A open source [REST](/@harrisonqian/awesome/wiki/miscellaneous/rest) API backend for mobile, web, and IoT applications. - [Graphweaver](https://github.com/exogee-technology/graphweaver) - Turn multiple data sources into a single [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql) API. - [Hasura [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql) Engine](https://github.com/hasura/graphql-engine) - Blazing fast, instant realtime [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql) APIs on [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) with fine grained access control, also trigger webhooks on [database](/@harrisonqian/awesome/wiki/databases/database) events. - [Oracle [REST](/@harrisonqian/awesome/wiki/miscellaneous/rest) Data Services](http://www.oracle.com/technetwork/developer-tools/rest-data-services) - A mid-tier [Java](/@harrisonqian/awesome/wiki/programming-languages/java) application, ORDS maps HTTP(S) verbs (GET, POST, PUT, DELETE, etc.) to [database](/@harrisonqian/awesome/wiki/databases/database) transactions and returns any results formatted using [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json). - [Prisma](https://github.com/prismagraphql/prisma) - Turns your [database](/@harrisonqian/awesome/wiki/databases/database) into a realtime [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql) API. - [PostGraphile](https://github.com/graphile/postgraphile) - Instantly spin-up a [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql) API server by pointing PostGraphile at your existing [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database). - [PostgREST](https://github.com/PostgREST/postgrest) - [REST](/@harrisonqian/awesome/wiki/miscellaneous/rest) API for any [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database). - [prest](https://github.com/prest/prest) - Is a way to serve a RESTful API from any databases written in Go. - [Remult](https://github.com/remult/remult) - End-to-end type-safe CRUD via [REST](/@harrisonqian/awesome/wiki/miscellaneous/rest) API for your [database](/@harrisonqian/awesome/wiki/databases/database), with fine-grained access control. - [restSQL](https://github.com/restsql/restsql) - SQL generator with [Java](/@harrisonqian/awesome/wiki/programming-languages/java) and HTTP APIs, uses a simple RESTful HTTP API with XML or [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json) serialization. - [resquel](https://github.com/formio/resquel) - Easily convert your SQL [database](/@harrisonqian/awesome/wiki/databases/database) into a [REST](/@harrisonqian/awesome/wiki/miscellaneous/rest) API. - [sandman2](https://github.com/jeffknupp/sandman2) - Automatically generate a RESTful API service for your legacy [database](/@harrisonqian/awesome/wiki/databases/database). - [soul](https://github.com/thevahidal/soul) - Automatic SQLite RESTful and realtime API server. - [VulcanSQL](https://github.com/Canner/vulcan-sql) - Write templated SQL to automatically exposing RESTful APIs from your database/data warehouse/data lake. ## Application platforms Low-code and no-code platforms for application building - [Appsmith](https://github.com/appsmithorg/appsmith) - Powerful open source [low code](/@harrisonqian/awesome/wiki/platforms/low-code) framework to build internal applications really quickly. - [Budibase](https://github.com/Budibase/budibase) - Low-code platform for creating internal [apps](/@harrisonqian/awesome/wiki/platforms/apps) in minutes. - [ILLA Cloud](https://github.com/illacloud/illa-builder) - Low-code internal tool building platform. - [Nhost](https://github.com/nhost/nhost) - The Open Source [Firebase](/@harrisonqian/awesome/wiki/platforms/firebase) Alternative with [GraphQL](/@harrisonqian/awesome/wiki/miscellaneous/graphql). - [Saltcorn](https://github.com/saltcorn/saltcorn) - Open source no-code builder for web datatabase applications. Server and drag-and-drop UI builder, data stored in [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) or SQLite. - [SQLPage](https://github.com/sqlpage/SQLPage) - Fast SQL-only data application builder. Automatically build a UI on top of SQL queries. - [Tooljet](https://github.com/ToolJet/ToolJet) - Open-source low-code platform to build internal tools. ## Backup - [BaRMan](https://github.com/2ndquadrant-it/barman) - Backup and Recovery Manager for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Databasus](https://github.com/databasus/databasus) - Tool for scheduled [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) backups via web UI with external storages (local, S3, FTP, Google Drive, etc.), notifications (webhook, Discord, [Slack](/@harrisonqian/awesome/wiki/work/slack), etc.) and team management. - [pgbackrest](https://github.com/pgbackrest/pgbackrest) - Reliable [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Backup & Restore. - [pgcopydb](https://github.com/dimitri/pgcopydb) - Copy a [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database) to a target PostgreSQL server (pg_dump | pg_restore on steroids). - [pg_probackup](https://github.com/postgrespro/pg_probackup) - A backup and recovery manager for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Portabase](https://github.com/Portabase/portabase) - Agent-based platform for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) backups and restores with decentralized execution and centralized orchestration. ## Cloning - [Database Lab Engine](https://gitlab.com/postgres-ai/database-lab) - Instant thin cloning for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) to scale the development process. - [clone_schema](https://github.com/denishpatel/pg-clone-schema) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) clone schema utility without need of going outside of [database](/@harrisonqian/awesome/wiki/databases/database). - [Spawn](https://spawn.cc/) - Cloud service for creating instant [database](/@harrisonqian/awesome/wiki/databases/database) copies for development and CI. No more local db installs, instant recovery to arbitrary save points, isolated copies for each feature branch or test. Instant provisioning regardless of database size. ## Monitoring/Statistics/Perfomance - [ASH Viewer](https://github.com/akardapolov/ASH-Viewer) - Provides a graphical view of active session history data within the Oracle and [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) DB. - [Metis](https://www.metisdata.io/product/troubleshooting) - Provides observability and performance tuning for SQL databases. - [Monyog](https://www.webyog.com/product/monyog) - Agentless & Cost-effective [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) Monitoring Tool. - [mssql-monitoring](https://github.com/microsoft/mssql-monitoring) - Monitor your SQL Server on [Linux](/@harrisonqian/awesome/wiki/platforms/linux) performance using collectd, [InfluxDB](/@harrisonqian/awesome/wiki/databases/influxdb) and Grafana. - [Navicat Monitor](https://www.navicat.com/en/products/navicat-monitor) - A safe, simple and agentless remote server monitoring tool that is packed with powerful features to make your monitoring effective as possible. - [Percona Monitoring and Management](https://github.com/percona/pmm) - Open source platform for managing and monitoring [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and [MongoDB](/@harrisonqian/awesome/wiki/databases/mongodb) performance. - [pganalyze collector](https://github.com/pganalyze/collector) - Pganalyze statistics collector for gathering [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) metrics and log data. - [pgbadger](https://github.com/dalibo/pgbadger) - A fast [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Log Analyzer. - [pgDash](https://pgdash.io) - Measure and track every aspect of your [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) databases. - [PgHero](https://github.com/ankane/pghero) - A performance dashboard for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) - health checks, suggested indexes, and more. - [pgmetrics](https://github.com/rapidloop/pgmetrics) - Collect and display information and stats from a running [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) server. - [pgMonitor](https://github.com/CrunchyData/pgmonitor) - All-in-one tool to easily create an environment to visualize the health and performance of your [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) cluster. - [pgMustard](https://www.pgmustard.com) - A user interface for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) explain plans, plus [tips](/@harrisonqian/awesome/wiki/programming-languages/tips) to improve performance. - [pgstats](https://github.com/gleu/pgstats) - Collects [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) statistics, and either saves them in CSV files or print them on the stdout. - [pgwatch2](https://github.com/cybertec-postgresql/pgwatch2) - Flexible self-contained [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) metrics monitoring/dashboarding solution. - [PostgreSQL Metrics](https://github.com/spotify/postgresql-metrics) - Service to extract and provide metrics on your [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database). - [PostgreSQL Monitor](https://postgresmonitor.com) - An easy-to-use monitoring service for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) providing alerts, dashboards, query stats and dynamic recommendations. - [postgres-checkup](https://gitlab.com/postgres-ai/postgres-checkup) - New-generation diagnostics tool that allows users to do a deep analysis of the health of [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) databases. - [Promscale](https://github.com/timescale/promscale) - The open-source observability backend for metrics and traces powered by SQL. - [Releem](https://releem.com) - Performance monitoring and optimization tool for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) & MariaDB that delivers actionable insights and safe automation for misconfigurations, slow queries, schema issues, and deadlocks, reducing manual work at scale. - [Telegraf [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) plugin](https://github.com/influxdata/telegraf/tree/master/plugins/inputs/postgresql) - Provides metrics for your PostgreSQL [database](/@harrisonqian/awesome/wiki/databases/database). ### Prometheus - [pgSCV](https://github.com/weaponry/pgscv) - Metrics exporter for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) and PostgreSQL-related services. - [postgres_exporter](https://github.com/wrouesnel/postgres_exporter) - [Prometheus](/@harrisonqian/awesome/wiki/miscellaneous/prometheus) exporter for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) server metrics. - [pg_exporter](https://github.com/Vonng/pg_exporter) - Fully customizable [Prometheus](/@harrisonqian/awesome/wiki/miscellaneous/prometheus) exporter for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) & Pgbouncer with fine-grained execution control. ### Zabbix - [Mamonsu](https://github.com/postgrespro/mamonsu) - Monitoring agent for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Orabbix](http://www.smartmarmot.com/wiki/index.php?title=Orabbix) - Plugin designed to work with Zabbix Enterprise Monitor to provide multi-tiered monitoring, performance and availability reporting and measurement for Oracle Databases, along with server performance metrics. - [pg_monz](https://github.com/pg-monz/pg_monz) - This is the Zabbix monitoring template for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [Database](/@harrisonqian/awesome/wiki/databases/database). - [Pyora](https://github.com/bicofino/Pyora) - [Python](/@harrisonqian/awesome/wiki/programming-languages/python) script to monitor Oracle Databases. - [ZabbixDBA](https://github.com/anetrusov/ZabbixDBA) - Fast, flexible, and continuously developing plugin to monitor your RDBMS. ## Testing - [DbFit](https://github.com/dbfit/dbfit) - A [database](/@harrisonqian/awesome/wiki/databases/database) [testing](/@harrisonqian/awesome/wiki/testing/testing) framework that supports easy test-driven development of your database code. - [pgTAP](https://github.com/theory/pgtap) - Unit [Testing](/@harrisonqian/awesome/wiki/testing/testing) for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [RegreSQL](https://github.com/dimitri/regresql) - Regression [Testing](/@harrisonqian/awesome/wiki/testing/testing) your SQL queries. - [SQLancer](https://github.com/sqlancer/sqlancer) - Automatically test DBMS in order to find logic bugs in their implementation. ## HA/Failover/Sharding - [Citus](https://github.com/citusdata/citus) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) extension that distributes your data and your queries across multiple nodes. - [patroni](https://github.com/zalando/patroni) - A template for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) High Availability with ZooKeeper, etcd, or Consul. - [Percona XtraDB Cluster](https://github.com/percona/percona-xtradb-cluster) - A High [Scalability](/@harrisonqian/awesome/wiki/front-end-development/scalability) Solution for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) Clustering and High Availability. - [ShardingSphere](https://github.com/apache/shardingsphere) - Distributed SQL transaction & query engine for data sharding, scaling, encryption, and more - on any [database](/@harrisonqian/awesome/wiki/databases/database). - [stolon](https://github.com/sorintlab/stolon) - Cloud native [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) manager for PostgreSQL high availability. - [pg_auto_failover](https://github.com/citusdata/pg_auto_failover) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) extension and service for automated failover and high-availability. - [pglookout](https://github.com/aiven/pglookout) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) replication monitoring and failover daemon. - [pgslice](https://github.com/ankane/pgslice) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) partitioning as easy as pie. - [PostgreSQL Automatic Failover](https://github.com/ClusterLabs/PAF) - High-Availibility for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), based on industry references Pacemaker and Corosync. - [autobase](https://github.com/vitabaks/autobase) - Open-source DBaaS that automates the deployment and management of highly available [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) clusters. - [Vitess](https://github.com/vitessio/vitess) - [Database](/@harrisonqian/awesome/wiki/databases/database) clustering system for horizontal scaling of [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) through generalized sharding. ## Kubernetes - [KubeDB](https://kubedb.com) - Making running production-grade databases easy on [Kubernetes](/@harrisonqian/awesome/wiki/back-end-development/kubernetes). - [PostgreSQL operator](https://github.com/zalando/postgres-operator) - The [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Operator enables highly-available PostgreSQL clusters on [Kubernetes](/@harrisonqian/awesome/wiki/back-end-development/kubernetes) (Kubernetes) powered by Patroni. - [Spilo](https://github.com/zalando/spilo) - HA [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Clusters with [Docker](/@harrisonqian/awesome/wiki/back-end-development/docker). - [StackGres](https://gitlab.com/ongresinc/stackgres) - Enterprise-grade, Full Stack [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) on [Kubernetes](/@harrisonqian/awesome/wiki/back-end-development/kubernetes). ## Configuration Tuning - [MySQLTuner-perl](https://github.com/major/MySQLTuner-perl) - Script written in [Perl](/@harrisonqian/awesome/wiki/programming-languages/perl) that allows you to review a [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) installation quickly and make adjustments to increase performance and stability. - [PGConfigurator](https://pgconfigurator.cybertec-[postgresql](/@harrisonqian/awesome/wiki/databases/postgresql).com) - Free online tool to generate an optimized `postgresql.conf`. - [pgtune](https://github.com/gregs1104/pgtune) - [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) configuration wizard. - [postgresqltuner.pl](https://github.com/jfcoz/postgresqltuner) - Simple script to analyse your [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database) configuration, and give tuning advice. ## DevOps - [DBmaestro](https://www.dbmaestro.com) - Accelerates release cycles & supports agility across the entire IT ecosystem. - [Toad DevOps Toolkit](https://www.quest.com/products/toad-devops-toolkit/) - Executes key [database](/@harrisonqian/awesome/wiki/databases/database) development functions within your DevOps workflow —without compromising quality, performance or reliability. ## Reporting - [Chartbrew](https://chartbrew.com) - Create live dashboards, charts, and client reports from multiple databases and services. - [Poli](https://github.com/shzlw/poli) - An easy-to-use SQL reporting application built for SQL lovers. ## Distributions - [DBdeployer](https://github.com/datacharmer/dbdeployer) - Tool that deploys [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) [database](/@harrisonqian/awesome/wiki/databases/database) servers easily. - [dbatools](https://github.com/sqlcollaborative/dbatools) - [PowerShell](/@harrisonqian/awesome/wiki/development-environment/powershell) module that you may think of like a command-line SQL Server Management Studio. - [Postgres.app](https://github.com/PostgresApp/PostgresApp) - Full-featured [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) installation packaged as a standard Mac app. - [BigSQL](https://www.bigsql.org) - A developer-friendly distribution of [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [Elephant Shed](https://github.com/credativ/elephant-shed) - Web-based [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) management front-end that bundles several utilities and applications for use with PostgreSQL. - [Pigsty](https://github.com/Vonng/pigsty) - Battery-Included Open-Source Distribution for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) with ultimate observability & [Database](/@harrisonqian/awesome/wiki/databases/database)-as-Code toolbox for developers. ## Security - [Acra](https://github.com/cossacklabs/acra) - [Database](/@harrisonqian/awesome/wiki/databases/database) [security](/@harrisonqian/awesome/wiki/security/security) suite. Database proxy with field-level encryption, search through encrypted data, SQL injections prevention, intrusion detection, [honeypots](/@harrisonqian/awesome/wiki/security/honeypots). Supports client-side and proxy-side ("transparent") encryption. SQL, NoSQL. - [Databunker](https://github.com/securitybunker/databunker) - Special [GDPR](/@harrisonqian/awesome/wiki/security/gdpr) compliant secure vault for customer records built on top of regular DB. - [Inspektor](https://github.com/poonai/inspektor) - Access control layer for databases. Inspektor leverages open policy agent to make policy decisions. ## SQL ### Analyzers - [Holistic.dev](https://holistic.dev) - Automatic detection service for [database](/@harrisonqian/awesome/wiki/databases/database) performance, [security](/@harrisonqian/awesome/wiki/security/security), and architecture issues. - [SQLCheck](https://github.com/jarulraj/sqlcheck) - Automatically detects common SQL anti-patterns. - [SQLFluff](https://github.com/sqlfluff/sqlfluff) - Dialect-flexible and configurable SQL linter. - [SQLLineage](https://github.com/reata/sqllineage) - SQL Lineage Analysis Tool powered by [Python](/@harrisonqian/awesome/wiki/programming-languages/python). - [TSQLLint](https://github.com/tsqllint/tsqllint) - A tool for describing, identifying, and reporting the presence of anti-patterns in TSQL scripts. ### Extensions - [PartiQL](https://partiql.org) - SQL-compatible access to relational, semi-structured, and nested data. ### Frameworks - [Apache Calcite](https://calcite.apache.org) - Dynamic data management framework with advanced SQL features. - [ZetaSQL](https://github.com/google/zetasql) - Analyzer Framework for SQL. ### Formatters - [CodeBuff](https://github.com/antlr/codebuff) - Language-agnostic pretty-printing through [machine learning](/@harrisonqian/awesome/wiki/computer-science/machine-learning). - [JSQLFormatter](https://github.com/manticore-projects/jsqlformatter) - Open Source [Java](/@harrisonqian/awesome/wiki/programming-languages/java) SQL Formatter for many RDBMS based on JSqlParser. - [SQL Online](https://sqlonline.in) - A Free Tool to format your SQL Queries followed by content for Analysts. - [pgFormatter](https://github.com/darold/pgFormatter) - A [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) SQL syntax beautifier. - [Poor SQL](https://poorsql.com) - Instant free and open-source T-SQL formatting. - [SQL Formatter](https://github.com/zeroturnaround/sql-formatter) - [JavaScript](/@harrisonqian/awesome/wiki/programming-languages/javascript) library for pretty-printing SQL queries. ### Games - [Lost at SQL](https://lost-at-sql.therobinlord.com) - A SQL [learning](/@harrisonqian/awesome/wiki/programming-languages/learning) game to help you pick up basic SQL skills - so that you can use queries to get information. - [Querymon](https://codepip.com/games/querymon/) - Learn to use SQL queries on the Querydex, a [database](/@harrisonqian/awesome/wiki/databases/database) of monsters from common to legendary. - [Schemaverse](https://datalemur.com/blog/games-to-learn-sql#schemaverse) - A Space-based strategy game implemented entirely within a [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) [database](/@harrisonqian/awesome/wiki/databases/database). - [SQL Island](https://sql-island.informatik.uni-kl.de) - After the survived plane crash, you will be stuck on SQL Island for the time being. By making progress in the game, you will find a way to escape from this island. - [SQL Murder Mystery](https://mystery.knightlab.com) - Designed to be both a self-directed lesson to learn SQL concepts and commands and a fun game for experienced SQL users to solve an intriguing crime. - [SQL Police Department](https://sqlpd.com) - In SQLPD, you get to solve crimes while [learning](/@harrisonqian/awesome/wiki/programming-languages/learning) SQL at the same time. ### Parsers - [General SQL Parser](https://www.sqlparser.com) - Parsing, formatting, modification and analysis for SQL. - [jOOQ](https://github.com/jOOQ/jOOQ) - Parses SQL, translates it to other dialects, and allows for expression tree transformations. - [JSqlParser](https://github.com/JSQLParser/JSqlParser) - Parses an SQL statement and translate it into a hierarchy of [Java](/@harrisonqian/awesome/wiki/programming-languages/java) classes. - [libpg_query](https://github.com/pganalyze/libpg_query) - C library for accessing the [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) parser outside of the server environment. - [More SQL Parsing!](https://github.com/klahnakoski/mo-sql-parsing) - Parse SQL into [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json). - [sqlparse](https://github.com/andialbrecht/sqlparse) - Non-validating SQL parser for [Python](/@harrisonqian/awesome/wiki/programming-languages/python). - [SQLGlot](https://github.com/tobymao/sqlglot) - Pure [Python](/@harrisonqian/awesome/wiki/programming-languages/python) SQL parser, transpiler, and builder. ### Über SQL Run SQL queries against anything - [CloudQuery](https://github.com/cloudquery/cloudquery) - Extracts, transforms, and loads your cloud assets into normalized [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) tables. - [csvq](https://github.com/mithrandie/csvq) - SQL-like query language for CSV. - [dsq](https://github.com/multiprocessio/dsq) - Commandline tool for running SQL queries against [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json), CSV, Excel, Parquet, and more. - [MAT Calcite plugin](https://github.com/vlsi/mat-calcite-plugin) - This plugin for Eclipse Memory Analyzer allows to query heap dump via SQL. - [OctoSQL](https://github.com/cube2222/octosql) - Query tool that allows you to join, analyse and transform data from multiple databases and file formats using SQL. - [osquery](https://github.com/osquery/osquery) - SQL powered operating system instrumentation, monitoring, and [analytics](/@harrisonqian/awesome/wiki/miscellaneous/analytics). - [Resmo](https://www.resmo.com) - Audit and evaluate resources using SQL. - [Steampipe](https://github.com/turbot/steampipe) - Use SQL to instantly query your cloud services (AWS, Azure, GCP and more). - [TextQL](https://github.com/dinedal/textql) - Execute SQL against structured text like CSV or TSV. - [trdsql](https://github.com/noborus/trdsql) - CLI tool that can execute SQL queries on CSV, LTSV, [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json) and TBLN. - [Trino](https://github.com/trinodb/trino) - Distributed SQL query engine designed to query large data sets distributed over one or more heterogeneous data sources. ### Language Server Protocol - [SQLLanguageServer](https://github.com/joe-re/sql-language-server) - SQL Language Server. - [sqls](https://github.com/lighttiger2505/sqls) - SQL Language Server written in Go. ### Learning Learning and puzzles for SQL - [Advanced SQL Puzzles](https://github.com/smpetersgithub/AdvancedSQLPuzzles) - Difficult set-based SQL puzzles. - [Hackerrank](https://www.hackerrank.com/domains/sql) - Practice coding, prepare for interviews, and get hired. - [Learn SQL in a Month of Lunches](https://www.manning.com/books/learn-sql-in-a-month-of-lunches) - A book about how to use SQL to retrieve, filter, and analyze data. - [LeetCode](https://leetcode.com/problemset/database) - Enhance your skills, expand your knowledge and prepare for technical interviews. - [Select Star SQL](https://selectstarsql.com) - Free interactive book which aims to be the best place on the internet for [learning](/@harrisonqian/awesome/wiki/programming-languages/learning) SQL. - [StrataScratch](https://www.stratascratch.com/blog/categories/sql) - [Data science](/@harrisonqian/awesome/wiki/programming-languages/data-science) educational resources. - [SQL Murder Mystery](https://github.com/NUKnightLab/sql-mysteries) - Self-directed lesson to learn SQL concepts and commands and a fun game for experienced SQL users to solve an intriguing crime. ### Plan - [pev2](https://github.com/dalibo/pev2) - A [Vue.js](/@harrisonqian/awesome/wiki/front-end-development/vue-js) component to show a graphical vizualization of a [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) execution plan. - [pg_flame](https://github.com/mgartner/pg_flame) - A flamegraph generator for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) `EXPLAIN ANALYZE` output. ### Scripts Useful SQL-scripts for various purposes - [DBA MultiTool](https://github.com/LowlyDBA/dba-multitool) - T-SQL scripts for the long haul: optimizing storage, on-the-fly documentation, and general administrative needs for SQL Server. - [pgx_scripts](https://github.com/pgexperts/pgx_scripts) - A collection of useful little scripts for [database](/@harrisonqian/awesome/wiki/databases/database) analysis and administration, created by our team at [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Experts. - [pgsql-bloat-estimation](https://github.com/ioguix/pgsql-bloat-estimation) - Queries to mesure statistical bloat in indexes and tables for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [pgWikiDont](https://gitlab.com/depesz/pgWikiDont) - SQL test that checks if your [database](/@harrisonqian/awesome/wiki/databases/database) follows rules from <https://wiki.[postgresql](/@harrisonqian/awesome/wiki/databases/postgresql).org/wiki/Don't_Do_This>. - [pg-utils](https://github.com/dataegret/pg-utils) - Useful [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) utilities. - [PostgreSQL cheat sheet](https://postgrescheatsheet.com) - Useful SQL-scripts and commands by <timescale.com>. - [postgres_dba](https://github.com/NikolayS/postgres_dba) - The missing set of useful tools for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) DBAs and all engineers. - [postgres_queries_and_commands.sql](https://gist.[github](/@harrisonqian/awesome/wiki/development-environment/github).com/rgreenjr/3637525) - Useful [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) Queries and Commands. - [TPT](https://github.com/tanelpoder/tpt-oracle) - These sqlplus scripts are for Oracle [Database](/@harrisonqian/awesome/wiki/databases/database) performance optimization & troubleshooting. ## Data - [dbt](https://github.com/dbt-labs/dbt-core) - Transform your data by simply writing select statements, while dbt handles turning these statements into tables and views in a data warehouse. - [QuickTable](https://quicktable.io) - Empowers everyone to access, clean, analyze, transform, and model data with no code. ### Catalog - [Amundsen](https://github.com/amundsen-io/amundsen) - Metadata driven application for improving the [productivity](/@harrisonqian/awesome/wiki/work/productivity) of data analysts, data scientists and engineers when interacting with data. - [DataHub](https://github.com/datahub-project/datahub) - The Metadata Platform for the Modern Data Stack. - [Marquez](https://github.com/MarquezProject/marquez) - Collect, aggregate, and visualize a data ecosystem's metadata. ### Lineage - [Dwh.dev](https://dwh.dev) - Nexgen data lineage for Snowflake. ### Generation/Masking/Subsetting - [Benerator](https://github.com/rapiddweller/rapiddweller-benerator-ce) - Generate, obfuscate (anonymize / pseudonymize) and migrate data for development, [testing](/@harrisonqian/awesome/wiki/testing/testing) and training purposes. - [dbForge Data Generator for MySQL](https://www.devart.com/dbforge/mysql/data-generator) - Powerful GUI tool for creating massive volumes of realistic test data. - [dbForge Data Generator for Oracle](https://www.devart.com/dbforge/oracle/data-generator) - Small but mighty GUI tool for populating Oracle schemas with tons of realistic test data. - [dbForge Data Generator for SQL Server](https://www.devart.com/dbforge/sql/data-generator) - Powerful GUI tool for a fast generation of meaningful test data for databases. - [Faker](https://github.com/faker-js/faker) - Generate massive amounts of fake data in the browser and [Node.js](/@harrisonqian/awesome/wiki/platforms/node-js). - [Greenmask](https://github.com/GreenmaskIO/greenmask) - [Database](/@harrisonqian/awesome/wiki/databases/database) anonymization and synthetic data generation tool for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) and [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [myanon](https://github.com/ppomes/myanon) - [Streaming](/@harrisonqian/awesome/wiki/big-data/streaming) anonymizer for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) dump files. Reads mysqldump from stdin, writes anonymized version to stdout. Supports deterministic hashing, fixed values, [JSON](/@harrisonqian/awesome/wiki/miscellaneous/json) field anonymization, and [Python](/@harrisonqian/awesome/wiki/programming-languages/python) extensions. - [Noisia](https://github.com/lesovsky/noisia) - Harmful workload generator for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). - [quick-seed](https://github.com/miit-daga/quick-seed) - [Database](/@harrisonqian/awesome/wiki/databases/database)-agnostic seeding tool for generating realistic test data with support for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), SQLite, [Prisma](/@harrisonqian/awesome/wiki/miscellaneous/prisma), and Drizzle ORM. - [SB Data Generator](https://soft-builder.com/sb-data-generator) - Simple and powerful tool to generate and populate selected tables or entire databases with realistic test data for your applications. Generate test data for: Oracle, MS SQL Server, [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), Firebird, SQLite, Azure SQL [Database](/@harrisonqian/awesome/wiki/databases/database), Amazon Redshift and Amazon RDS. - [SQLable](https://sqlable.com/generator/) - Generate fake data in the browser. - [Synthesized TDK](https://docs.synthesized.io/tdk/latest) - DevOps' best friend for [database](/@harrisonqian/awesome/wiki/databases/database) masking and generation. ### Data Profilers - [Data Profiler](https://github.com/capitalone/dataprofiler) - The DataProfiler is a [Python](/@harrisonqian/awesome/wiki/programming-languages/python) library designed to make data analysis, monitoring, and sensitive data detection easy. - [Desbordante](https://github.com/desbordante/desbordante-core) - An open-source data profiler specifically focused on discovery and validation of complex patterns in data. - [YData Profiling](https://github.com/ydataai/ydata-profiling) - A general-purpose open-source data profiler for high-level analysis of a dataset. ### Replication - [dtle](https://github.com/actiontech/dtle) - Distributed Data Transfer Service for [MySQL](/@harrisonqian/awesome/wiki/databases/mysql). - [Litestream](https://github.com/benbjohnson/litestream) - [Streaming](/@harrisonqian/awesome/wiki/big-data/streaming) replication for SQLite. - [pgsync](https://github.com/ankane/pgsync) - Sync [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) data between databases. - [pg_chameleon](https://github.com/the4thdoctor/pg_chameleon) - [MySQL](/@harrisonqian/awesome/wiki/databases/mysql) to [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) replica system written in [Python](/@harrisonqian/awesome/wiki/programming-languages/python) 3. The system use the library mysql-replication to pull the row images from MySQL which are stored into PostgreSQL as JSONB. - [PGDeltaStream](https://github.com/hasura/pgdeltastream) - A Golang webserver to stream [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql) changes atleast-once over websockets, using PostgreSQL logical decoding feature. - [repmgr](https://github.com/2ndQuadrant/repmgr) - The Most Popular Replication Manager for [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql). ### Compare - [data-diff](https://github.com/datafold/data-diff) - Command-line tool and [Python](/@harrisonqian/awesome/wiki/programming-languages/python) library to efficiently diff rows across two different databases. - [KS DB Merge Tools](https://ksdbmerge.tools) - GUI to compare and sync DB schema and data. For Oracle [Database](/@harrisonqian/awesome/wiki/databases/database), [MySQL](/@harrisonqian/awesome/wiki/databases/mysql), MariaDB, SQL Server, [PostgreSQL](/@harrisonqian/awesome/wiki/databases/postgresql), SQLite, MS Access and Cross-DBMS. ## Papers Documents, articles, manifestos and other theoretical materials on database tools - [The "[Database](/@harrisonqian/awesome/wiki/databases/database) as Code" Manifesto](https://github.com/mgramin/database-as-code) - Treat your database as Code. - [Grokking Relational [Database](/@harrisonqian/awesome/wiki/databases/database) Design](https://www.manning.com/books/grokking-relational-database-design) - A friendly illustrated guide to designing and implementing your first database. ## Machine Learning - [MindsDB](https://github.com/mindsdb/mindsdb) - In-[database](/@harrisonqian/awesome/wiki/databases/database) [Machine Learning](/@harrisonqian/awesome/wiki/computer-science/machine-learning). - [SQLFlow](https://github.com/sql-machine-learning/sqlflow) - Brings SQL and AI together. ## Contributing - Your contributions are always welcome! Please read the [contribution guidelines](contributing.md) first.