copying sqlite databases from remote sources can be done faster by .dump it to a text file, this will be smaller than the db if you have lots of indexes (to speed queries up) then compress the text file download, unzip, and reconstruct locally as sqlite db
- Last 7 days
-
alexwlchan.net alexwlchan.net
Tags
Annotators
URL
-
-
betterstack.com betterstack.com
-
There is an experimental Node.js module to natively support sqlite. You can have a sqlite db in memory during the execution of a program, for temp data. And use the file based dbs.
-
-
freshrss.github.io freshrss.github.io
-
FreshRSS supports the databases SQLite (built-in),
Fresh RSS is sqlite
-
-
sqlitebrowser.org sqlitebrowser.org
-
dbbrowser for sqlite, installed, works
-
-
sqlitestudio.pl sqlitestudio.pl
-
FOSS tool for sqlite.
-
-
-
tool to browse sqlite databases, but also a bunch of others. Costs 100USD though
-
-
-
Limitations and Considerations While SQLite is powerful and versatile, it’s important to understand its limitations:ezstandalone.cmd.push(function () { ezstandalone.showAds(119); }); Concurrency: SQLite uses file-based locking, which can limit concurrent write operations. It’s not suitable for high-concurrency scenarios. Network access: SQLite is designed for local storage and doesn’t provide network access out of the box. User management: SQLite doesn’t have built-in user management or access control features.ezstandalone.cmd.push(function () { ezstandalone.showAds(120); }); Scalability: While SQLite can handle databases up to 140 terabytes, it may not be the best choice for very large datasets or high-traffic applications. Alter table limitations: SQLite has limited support for ALTER TABLE operations compared to other database systems.
Llimitations are low concurrency (not an issue, unless I write from multiple applications/scripts to the same thing) local only/mostly, fine too user management, not an issue, just me scalability, not suited to large amounts. The premise is that I won't have lots of data ALTER TABLE limitations, this may mean rebulds/redesigns as things evolve?
-
Best Practices for Using SQLite on Mac
make regular backups with the .dump command (you can cron job this) optimize queries use right data types indexing rebuild often to reclaim unused space (VACUUM) command use prepared statements in my code
-
DB Browser for SQLite: A free, open-source tool that provides a user-friendly interface for creating, designing, and editing SQLite database files. TablePlus: A native macOS application that supports multiple database systems, including SQLite.ezstandalone.cmd.push(function () { ezstandalone.showAds(116); }); SQLite Studio: Another free, open-source option with a rich feature set for managing SQLite databases.
three Mac tools for interacting w sqlite thru GUI. DB Browser, TablePlus and SQLite Studio. TablePlus is a mac app, the other two FOSS tools.
-
Optimizing SQLite Performance
often used columns/tables can be indexed for better performance
-
JSON support:
sqlite can parse json for inputs.
-
FeatureSQLiteMySQLPostgreSQLServerServerlessClient-serverClient-serverSetupNo setup requiredRequires installationRequires installationConcurrencyLimitedHighHighData TypesDynamicStaticStaticMax Database Size140 TBNo limitNo limitBest ForLocal storage, PrototypesWeb apps, Large datasetsComplex queries, Big dataPerformanceFast for small datasetsFast for large datasetsFast for large datasetsPortabilityHighly portableLess portableLess portable
[[Martijn Aslander]]'s point was that all your personal data is in size limited to MBs, perhaps a handfull GBs. (He keeps out his documents and mail archives) Compared to table, a few 10s of GB should be doable and still be fast.
-
SQLite integrates seamlessly with Python. Here’s a simple script to interact with our database: import sqlite3 import pandas as pd # Connect to the database conn = sqlite3.connect('analytics.db') # Create a cursor cur = conn.cursor() # Execute a query cur.execute(""" SELECT pv.page_url, pv.view_count, COUNT(uv.id) as unique_visitors FROM page_views pv LEFT JOIN user_visits uv ON pv.id = uv.page_id GROUP BY pv.id ORDER BY pv.view_count DESC """) # Fetch all rows rows = cur.fetchall() # Create a pandas DataFrame df = pd.DataFrame(rows, columns=['Page URL', 'View Count', 'Unique Visitors']) print(df) # Close the connection conn.close()
sqlite integrates w python. what about php?
-
Let’s create a sample database file: sqlite3 analytics.db
making a new sqlite database is as easy as in terminal sqlite3 name.db
Tags
Annotators
URL
-
-
www.geeksforgeeks.org www.geeksforgeeks.org
-
It supports terabyte-sized databases and gigabyte-sized strings and blobs.
sqlite can handle large volumes, up to 1TB
-
SQLite stores all of the data in a single file on the filesystem, which makes it easy to copy or backup the database.
sqlite is a single local file
-
What is sqlite. I've used mysql/php since forever. [[Martijn Aslander]] showed his personal information browser which is based on sqlite, and it was fast.
Tags
Annotators
URL
-
- Nov 2025
-
en.wikipedia.org en.wikipedia.org
-
https://en.wikipedia.org/wiki/Soundex
There is a close relationship between the Soundex indexing scheme and the scheme behind the Major System!!!
Tags
- Oracle
- PostgreSQL
- IBM Db2
- SQLite
- National Archives and Records Administration (NARA)
- Donald Knuth
- phonetic algorithms
- Census Bureau
- indexing systems
- ClickHouse
- MySQL
- MS SQL Server
- phonetics
- Snowflake
- Major system
- Soundex
- Robert C. Russell
- SAP ASE
- Margaret King Odell
- Ingres
- algorithms
Annotators
URL
-
- Aug 2023
-
www.reddit.com www.reddit.com
-
Old web demo I made of sociologist Niklas Luhmann's zettelkasten with automatic reference and back reference indices (don't visit on mobile data, it's a data-heavy app 16MiB) .t3_16562do._2FCtq-QzlfuN-SwVMUZMM3 { --postTitle-VisitedLinkColor: #9b9b9b; --postTitleLink-VisitedLinkColor: #9b9b9b; --postBodyLink-VisitedLinkColor: #989898; }
via u/epilys at https://www.reddit.com/r/Zettelkasten/comments/16562do/old_web_demo_i_made_of_sociologist_niklas/
https://epilys.github.io/bibliothecula/web-demo/zettel.html
I wrote this one as a weekend project for fun back in 2021. It was supposed to be a demo for this article that gives a way to use a database software (called sqlite) to create a Zettelkasten:
-
-
hashnode.com hashnode.com
-
Full text seach is a way to avoid these two issues. With SQLite, you enable full text search by creating what is called a "virtual table" using one of the FTS engines included with SQLite: FTS4 or FTS5. FTS5 support is the most recent and has more advanced searching features, including ranking and highlighting of results and is what is described here.
This is the advantage of using FTS5 - it'you get the ranking and highlighting that you might otherwise assocaite with Postgres or other bigger databases that have search capabilities
-
- Feb 2023
-
motherduck.com motherduck.com
-
Most applications do not need to process massive amounts of data. This has led to a resurgence in data management systems with traditional architectures; SQLite, Postgres, MySQL are all growing strongly, while “NoSQL” and even “NewSQL” systems are stagnating.
SQL still shines over NoSQL
Tags
Annotators
URL
-
-
corecursive.com corecursive.com
-
Richard was a contractor for Bath Iron Works working on software for the DDG-79 Oscar Austin.
Tags
Annotators
URL
-
- Nov 2022
-
discourse.devontechnologies.com discourse.devontechnologies.com
-
I work primarily on Windows, but I support my kids who primarily use Mac for their college education. I have used DT on Mac, IPOS, IOS for about a year. On Windows, I have been using Kinook’s UltraRecall (UR) for the past 15 years. It is both a knowledge outliner and document manager. Built on top of a sql lite database. You can use just life DT and way way more. Of course, there is no mobile companion for UR. The MS Windows echo system in this regard is at least 12 years behind.
Reference for UltraRecall (UR) being the most DEVONthink like Windows alternative. No mobile companion for UR. Look into this being paired with Obsidian
-
- May 2022
-
cagrimmett.com cagrimmett.com
-
The highlights you made in FreeTime are preserved in My Clippings.txt, but you can’t see them on the Kindle unless you are in FreeTime mode. Progress between FreeTime and regular mode are tracked separately, too. I now pretty much only use my Kindle in FreeTime mode so that my reading statistics are tracked. If you are a data nerd and want to crunch the data on your own, it is stored in a SQLite file on your device under system > freetime > freetime.db.
FreeTime mode on the Amazon Kindle will provide you with reading statistics. You can find the raw data as an SQLite file under system > freetime > freetime.db.
-
- Mar 2022
-
riffle.systems riffle.systems
Tags
Annotators
URL
-
-
boredcaveman.xyz boredcaveman.xyz
-
jlongster.com jlongster.com
-
- Dec 2021
-
anita-app.com anita-app.com
- May 2021
-
phiresky.github.io phiresky.github.io
- Apr 2021
-
antonz.org antonz.org
-
The console is a killer SQLite feature for data analysis: more powerful than Excel and more simple than pandas. One can import CSV data with a single command, the table is created automatically: > .import --csv city.csv city > select count(*) from city; 1117
Tags
Annotators
URL
-
- Mar 2021
-
antonz.org antonz.org
-
The console is a killer SQLite feature for data analysis: more powerful than Excel and more simple than pandas. One can import CSV data with a single command, the table is created automatically
SQLite makes it fairly easy to import and analyse data. For example:
import --csv city.csv cityselect count(*) from city;
Tags
Annotators
URL
-
- Sep 2020
-
medium.com medium.com
-
The Realm is a new database module that is improving the way databases are used and also supports relationships between objects. If you are part of the SQL development world, then you must be familiar with the Realm.
-
-
www.excellentwebworld.com www.excellentwebworld.com
-
In this writeup, we will be discussing one such important prerequisite that is React Native database. We can call it the backbone of React Native applications.
-