33 Matching Annotations
  1. Last 7 days
    1. copying sqlite databases from remote sources can be done faster by .dump it to a text file, this will be smaller than the db if you have lots of indexes (to speed queries up) then compress the text file download, unzip, and reconstruct locally as sqlite db

    Tags

    Annotators

    URL

    1. Limitations and Considerations While SQLite is powerful and versatile, it’s important to understand its limitations:ezstandalone.cmd.push(function () { ezstandalone.showAds(119); }); Concurrency: SQLite uses file-based locking, which can limit concurrent write operations. It’s not suitable for high-concurrency scenarios. Network access: SQLite is designed for local storage and doesn’t provide network access out of the box. User management: SQLite doesn’t have built-in user management or access control features.ezstandalone.cmd.push(function () { ezstandalone.showAds(120); }); Scalability: While SQLite can handle databases up to 140 terabytes, it may not be the best choice for very large datasets or high-traffic applications. Alter table limitations: SQLite has limited support for ALTER TABLE operations compared to other database systems.

      Llimitations are low concurrency (not an issue, unless I write from multiple applications/scripts to the same thing) local only/mostly, fine too user management, not an issue, just me scalability, not suited to large amounts. The premise is that I won't have lots of data ALTER TABLE limitations, this may mean rebulds/redesigns as things evolve?

    2. Best Practices for Using SQLite on Mac

      make regular backups with the .dump command (you can cron job this) optimize queries use right data types indexing rebuild often to reclaim unused space (VACUUM) command use prepared statements in my code

    3. DB Browser for SQLite: A free, open-source tool that provides a user-friendly interface for creating, designing, and editing SQLite database files. TablePlus: A native macOS application that supports multiple database systems, including SQLite.ezstandalone.cmd.push(function () { ezstandalone.showAds(116); }); SQLite Studio: Another free, open-source option with a rich feature set for managing SQLite databases.

      three Mac tools for interacting w sqlite thru GUI. DB Browser, TablePlus and SQLite Studio. TablePlus is a mac app, the other two FOSS tools.

    4. FeatureSQLiteMySQLPostgreSQLServerServerlessClient-serverClient-serverSetupNo setup requiredRequires installationRequires installationConcurrencyLimitedHighHighData TypesDynamicStaticStaticMax Database Size140 TBNo limitNo limitBest ForLocal storage, PrototypesWeb apps, Large datasetsComplex queries, Big dataPerformanceFast for small datasetsFast for large datasetsFast for large datasetsPortabilityHighly portableLess portableLess portable

      [[Martijn Aslander]]'s point was that all your personal data is in size limited to MBs, perhaps a handfull GBs. (He keeps out his documents and mail archives) Compared to table, a few 10s of GB should be doable and still be fast.

    5. SQLite integrates seamlessly with Python. Here’s a simple script to interact with our database: import sqlite3 import pandas as pd # Connect to the database conn = sqlite3.connect('analytics.db') # Create a cursor cur = conn.cursor() # Execute a query cur.execute(""" SELECT pv.page_url, pv.view_count, COUNT(uv.id) as unique_visitors FROM page_views pv LEFT JOIN user_visits uv ON pv.id = uv.page_id GROUP BY pv.id ORDER BY pv.view_count DESC """) # Fetch all rows rows = cur.fetchall() # Create a pandas DataFrame df = pd.DataFrame(rows, columns=['Page URL', 'View Count', 'Unique Visitors']) print(df) # Close the connection conn.close()

      sqlite integrates w python. what about php?

  2. Nov 2025
  3. Aug 2023
    1. Old web demo I made of sociologist Niklas Luhmann's zettelkasten with automatic reference and back reference indices (don't visit on mobile data, it's a data-heavy app 16MiB) .t3_16562do._2FCtq-QzlfuN-SwVMUZMM3 { --postTitle-VisitedLinkColor: #9b9b9b; --postTitleLink-VisitedLinkColor: #9b9b9b; --postBodyLink-VisitedLinkColor: #989898; }

      via u/epilys at https://www.reddit.com/r/Zettelkasten/comments/16562do/old_web_demo_i_made_of_sociologist_niklas/

      https://epilys.github.io/bibliothecula/web-demo/zettel.html

      I wrote this one as a weekend project for fun back in 2021. It was supposed to be a demo for this article that gives a way to use a database software (called sqlite) to create a Zettelkasten:

      https://epilys.github.io/bibliothecula/notekeeping.html

    1. Full text seach is a way to avoid these two issues. With SQLite, you enable full text search by creating what is called a "virtual table" using one of the FTS engines included with SQLite: FTS4 or FTS5. FTS5 support is the most recent and has more advanced searching features, including ranking and highlighting of results and is what is described here.

      This is the advantage of using FTS5 - it'you get the ranking and highlighting that you might otherwise assocaite with Postgres or other bigger databases that have search capabilities

  4. Feb 2023
  5. Nov 2022
    1. I work primarily on Windows, but I support my kids who primarily use Mac for their college education. I have used DT on Mac, IPOS, IOS for about a year. On Windows, I have been using Kinook’s UltraRecall (UR) for the past 15 years. It is both a knowledge outliner and document manager. Built on top of a sql lite database. You can use just life DT and way way more. Of course, there is no mobile companion for UR. The MS Windows echo system in this regard is at least 12 years behind.

      Reference for UltraRecall (UR) being the most DEVONthink like Windows alternative. No mobile companion for UR. Look into this being paired with Obsidian

  6. May 2022
    1. The highlights you made in FreeTime are preserved in My Clippings.txt, but you can’t see them on the Kindle unless you are in FreeTime mode. Progress between FreeTime and regular mode are tracked separately, too. I now pretty much only use my Kindle in FreeTime mode so that my reading statistics are tracked. If you are a data nerd and want to crunch the data on your own, it is stored in a SQLite file on your device under system > freetime > freetime.db.

      FreeTime mode on the Amazon Kindle will provide you with reading statistics. You can find the raw data as an SQLite file under system > freetime > freetime.db.

  7. Mar 2022
  8. Dec 2021
  9. May 2021
  10. Apr 2021
    1. The console is a killer SQLite feature for data analysis: more powerful than Excel and more simple than pandas. One can import CSV data with a single command, the table is created automatically: > .import --csv city.csv city > select count(*) from city; 1117
  11. Mar 2021
    1. The console is a killer SQLite feature for data analysis: more powerful than Excel and more simple than pandas. One can import CSV data with a single command, the table is created automatically

      SQLite makes it fairly easy to import and analyse data. For example:

      • import --csv city.csv city
      • select count(*) from city;
  12. Sep 2020