Running SQLite in the browser with sql.js and WASM — a practical guide with Google Drive sync
Deeshan Shar
·
2026-04-28
·
via DEV Community
<p>Most tutorials on client-side data storage reach for IndexedDB, localStorage, or a third-party sync service. This one goes somewhere different: a real SQLite database, running as WebAssembly in the browser, with the database file living on the user's own Google Drive.</p> <p>This is the setup behind <a href="https://overtimeiq.vercel.app?ref=devto" rel="noopener noreferrer">OvertimeIQ</a> — but everything in this article stands alone as a practical reference. You don't need to care about overtime tracking for any of this to be useful.</p> <p>By the end, you'll know how to:</p> <ul> <li>Initialize sql.js and run real SQL in the browser</li> <li>Persist the database across page reloads via localStorage</li> <li>Upload and download the database file from Google Drive</li> <li>Handle sync conflicts correctly</li> <li>Protect against data corruption on interrupted uploads</li> </ul> <h2> Why SQLite in the browser? </h2> <p>Before we write any code, it's worth asking why you'd reach for SQLite instead of IndexedDB or a cloud-synced store.</p> <p>The answer is <strong>portability</strong>. A SQLite database is a single binary file. You can open it on any device, in any SQLite-compatible tool, without installing anything. You can attach it to an email, drop it in Dropbox, or — as we'll do here — store it on Google Drive. The user owns a file, not a schema locked inside a browser's internal storage.</p> <p>For apps where user data portability matters — personal finance tools, health tracking, anything sensitive — this is a meaningful architectural choice, not just a curiosity.</p> <p>The trade-off: sql.js ships a ~1.5MB WASM binary. We'll deal with that below.</p> <h2> Setting up sql.js </h2> <p>Install the package:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>npm <span class="nb">install </span>sql.js </code></pre> </div> <p>The WASM binary needs to be accessible at a URL your code can load. Copy it into your <code>public</code> folder at build time:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="c1">// vite.config.js</span> <span class="k">import</span> <span class="p">{</span> <span class="nx">defineConfig</span> <span class="p">}</span> <span class="k">from</span> <span class="dl">'</span><span class="s1">vite</span><span class="dl">'</span> <span class="k">import</span> <span class="p">{</span> <span class="nx">viteStaticCopy</span> <span class="p">}</span> <span class="k">from</span> <span class="dl">'</span><span class="s1">vite-plugin-static-copy</span><span class="dl">'</span> <span class="k">export</span> <span class="k">default</span> <span class="nf">defineConfig</span><span class="p">({</span> <span class="na">plugins</span><span class="p">:</span> <span class="p">[</span> <span class="nf">viteStaticCopy</span><span class="p">({</span> <span class="na">targets</span><span class="p">:</span> <span class="p">[</span> <span class="p">{</span> <span class="na">src</span><span class="p">:</span> <span class="dl">'</span><span class="s1">node_modules/sql.js/dist/sql-wasm.wasm</span><span class="dl">'</span><span class="p">,</span> <span class="na">dest</span><span class="p">:</span> <span class="dl">''</span> <span class="p">}</span> <span class="p">]</span> <span class="p">})</span> <span class="p">]</span> <span class="p">})</span> </code></pre> </div> <p>Now initialise sql.js. This is async — the WASM binary has to load before you can do anything:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="c1">// lib/db.js</span> <span class="k">import</span> <span class="nx">initSqlJs</span> <span class="k">from</span> <span class="dl">'</span><span class="s1">sql.js</span><span class="dl">'</span> <span class="kd">let</span> <span class="nx">db</span> <span class="o">=</span> <span class="kc">null</span> <span class="k">export</span> <span class="k">async</span> <span class="kd">function</span> <span class="nf">initDB</span><span class="p">(</span><span class="nx">existingBuffer</span> <span class="o">=</span> <span class="kc">null</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">SQL</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">initSqlJs</span><span class="p">({</span> <span class="na">locateFile</span><span class="p">:</span> <span class="nx">file</span> <span class="o">=></span> <span class="s2">`/</span><span class="p">${</span><span class="nx">file</span><span class="p">}</span><span class="s2">`</span> <span class="c1">// points to /sql-wasm.wasm in public/</span> <span class="p">})</span> <span class="k">if </span><span class="p">(</span><span class="nx">existingBuffer</span><span class="p">)</span> <span class="p">{</span> <span class="c1">// Restore from a saved buffer (localStorage or Drive download)</span> <span class="nx">db</span> <span class="o">=</span> <span class="k">new</span> <span class="nx">SQL</span><span class="p">.</span><span class="nc">Database</span><span class="p">(</span><span class="k">new</span> <span class="nc">Uint8Array</span><span class="p">(</span><span class="nx">existingBuffer</span><span class="p">))</span> <span class="p">}</span> <span class="k">else</span> <span class="p">{</span> <span class="c1">// Fresh database</span> <span class="nx">db</span> <span class="o">=</span> <span class="k">new</span> <span class="nx">SQL</span><span class="p">.</span><span class="nc">Database</span><span class="p">()</span> <span class="p">}</span> <span class="k">return</span> <span class="nx">db</span> <span class="p">}</span> </code></pre> </div> <p><strong>Lazy loading matters here.</strong> Don't initialise the database on app load. Initialise it on first access. With a Service Worker caching the WASM binary after the first load, subsequent loads are instant — but you still don't want to block your UI render on a 1.5MB download for users on their first visit.</p> <h2> Running SQL </h2> <p>sql.js has two main operations:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="c1">// For SELECT — returns an array of result objects</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">runQuery</span><span class="p">(</span><span class="nx">sql</span><span class="p">,</span> <span class="nx">params</span> <span class="o">=</span> <span class="p">[])</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">stmt</span> <span class="o">=</span> <span class="nx">db</span><span class="p">.</span><span class="nf">prepare</span><span class="p">(</span><span class="nx">sql</span><span class="p">)</span> <span class="nx">stmt</span><span class="p">.</span><span class="nf">bind</span><span class="p">(</span><span class="nx">params</span><span class="p">)</span> <span class="kd">const</span> <span class="nx">rows</span> <span class="o">=</span> <span class="p">[]</span> <span class="k">while </span><span class="p">(</span><span class="nx">stmt</span><span class="p">.</span><span class="nf">step</span><span class="p">())</span> <span class="p">{</span> <span class="nx">rows</span><span class="p">.</span><span class="nf">push</span><span class="p">(</span><span class="nx">stmt</span><span class="p">.</span><span class="nf">getAsObject</span><span class="p">())</span> <span class="p">}</span> <span class="nx">stmt</span><span class="p">.</span><span class="nf">free</span><span class="p">()</span> <span class="k">return</span> <span class="nx">rows</span> <span class="p">}</span> <span class="c1">// For INSERT / UPDATE / DELETE — no return value</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">execSQL</span><span class="p">(</span><span class="nx">sql</span><span class="p">,</span> <span class="nx">params</span> <span class="o">=</span> <span class="p">[])</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">stmt</span> <span class="o">=</span> <span class="nx">db</span><span class="p">.</span><span class="nf">prepare</span><span class="p">(</span><span class="nx">sql</span><span class="p">)</span> <span class="nx">stmt</span><span class="p">.</span><span class="nf">run</span><span class="p">(</span><span class="nx">params</span><span class="p">)</span> <span class="nx">stmt</span><span class="p">.</span><span class="nf">free</span><span class="p">()</span> <span class="p">}</span> <span class="c1">// Convenience wrapper for single-row queries</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">getOne</span><span class="p">(</span><span class="nx">sql</span><span class="p">,</span> <span class="nx">params</span> <span class="o">=</span> <span class="p">[])</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">rows</span> <span class="o">=</span> <span class="nf">runQuery</span><span class="p">(</span><span class="nx">sql</span><span class="p">,</span> <span class="nx">params</span><span class="p">)</span> <span class="k">return</span> <span class="nx">rows</span><span class="p">.</span><span class="nx">length</span> <span class="o">></span> <span class="mi">0</span> <span class="p">?</span> <span class="nx">rows</span><span class="p">[</span><span class="mi">0</span><span class="p">]</span> <span class="p">:</span> <span class="kc">null</span> <span class="p">}</span> </code></pre> </div> <p>Usage is exactly what you'd expect from a SQL library:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="nf">execSQL</span><span class="p">(</span> <span class="dl">'</span><span class="s1">INSERT INTO logs (job_id, date, start_time, end_time, duration_hours, location) VALUES (?, ?, ?, ?, ?, ?)</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="mi">1</span><span class="p">,</span> <span class="dl">'</span><span class="s1">2025-04-14</span><span class="dl">'</span><span class="p">,</span> <span class="dl">'</span><span class="s1">20:00</span><span class="dl">'</span><span class="p">,</span> <span class="dl">'</span><span class="s1">23:30</span><span class="dl">'</span><span class="p">,</span> <span class="mf">3.5</span><span class="p">,</span> <span class="dl">'</span><span class="s1">office</span><span class="dl">'</span><span class="p">]</span> <span class="p">)</span> <span class="kd">const</span> <span class="nx">logs</span> <span class="o">=</span> <span class="nf">runQuery</span><span class="p">(</span> <span class="dl">'</span><span class="s1">SELECT * FROM logs WHERE date >= ? ORDER BY date DESC</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="dl">'</span><span class="s1">2025-01-01</span><span class="dl">'</span><span class="p">]</span> <span class="p">)</span> </code></pre> </div> <h2> Schema migrations </h2> <p>You need a migration runner. The pattern I use: a <code>schema_version</code> table with a single integer, and a list of migration functions keyed by version number.<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="kd">const</span> <span class="nx">MIGRATIONS</span> <span class="o">=</span> <span class="p">{</span> <span class="mi">1</span><span class="p">:</span> <span class="p">(</span><span class="nx">db</span><span class="p">)</span> <span class="o">=></span> <span class="p">{</span> <span class="nx">db</span><span class="p">.</span><span class="nf">run</span><span class="p">(</span><span class="s2">` CREATE TABLE IF NOT EXISTS jobs ( id INTEGER PRIMARY KEY AUTOINCREMENT, name TEXT NOT NULL, hourly_rate REAL NOT NULL, weekend_multiplier REAL DEFAULT 1.5, holiday_multiplier REAL DEFAULT 2.0, work_start TEXT NOT NULL, work_end TEXT NOT NULL, color TEXT DEFAULT '#3B8BD4', is_default INTEGER DEFAULT 0, created_at TEXT NOT NULL ) `</span><span class="p">)</span> <span class="nx">db</span><span class="p">.</span><span class="nf">run</span><span class="p">(</span><span class="s2">` CREATE TABLE IF NOT EXISTS logs ( id INTEGER PRIMARY KEY AUTOINCREMENT, job_id INTEGER REFERENCES jobs(id), date TEXT NOT NULL, start_time TEXT NOT NULL, end_time TEXT NOT NULL, crosses_midnight INTEGER DEFAULT 0, duration_hours REAL NOT NULL, location TEXT NOT NULL, notes TEXT, created_at TEXT NOT NULL, updated_at TEXT NOT NULL ) `</span><span class="p">)</span> <span class="nx">db</span><span class="p">.</span><span class="nf">run</span><span class="p">(</span><span class="dl">'</span><span class="s1">CREATE INDEX IF NOT EXISTS idx_logs_date ON logs(date)</span><span class="dl">'</span><span class="p">)</span> <span class="p">}</span> <span class="p">}</span> <span class="k">export</span> <span class="k">async</span> <span class="kd">function</span> <span class="nf">runMigrations</span><span class="p">(</span><span class="nx">db</span><span class="p">)</span> <span class="p">{</span> <span class="nx">db</span><span class="p">.</span><span class="nf">run</span><span class="p">(</span><span class="dl">'</span><span class="s1">CREATE TABLE IF NOT EXISTS schema_version (version INTEGER NOT NULL)</span><span class="dl">'</span><span class="p">)</span> <span class="kd">const</span> <span class="nx">row</span> <span class="o">=</span> <span class="nf">getOne</span><span class="p">(</span><span class="dl">'</span><span class="s1">SELECT version FROM schema_version</span><span class="dl">'</span><span class="p">)</span> <span class="kd">const</span> <span class="nx">currentVersion</span> <span class="o">=</span> <span class="nx">row</span> <span class="p">?</span> <span class="nx">row</span><span class="p">.</span><span class="nx">version</span> <span class="p">:</span> <span class="mi">0</span> <span class="kd">const</span> <span class="nx">pendingVersions</span> <span class="o">=</span> <span class="nb">Object</span><span class="p">.</span><span class="nf">keys</span><span class="p">(</span><span class="nx">MIGRATIONS</span><span class="p">)</span> <span class="p">.</span><span class="nf">map</span><span class="p">(</span><span class="nb">Number</span><span class="p">)</span> <span class="p">.</span><span class="nf">filter</span><span class="p">(</span><span class="nx">v</span> <span class="o">=></span> <span class="nx">v</span> <span class="o">></span> <span class="nx">currentVersion</span><span class="p">)</span> <span class="p">.</span><span class="nf">sort</span><span class="p">((</span><span class="nx">a</span><span class="p">,</span> <span class="nx">b</span><span class="p">)</span> <span class="o">=></span> <span class="nx">a</span> <span class="o">-</span> <span class="nx">b</span><span class="p">)</span> <span class="k">for </span><span class="p">(</span><span class="kd">const</span> <span class="nx">version</span> <span class="k">of</span> <span class="nx">pendingVersions</span><span class="p">)</span> <span class="p">{</span> <span class="nx">MIGRATIONS</span><span class="p">[</span><span class="nx">version</span><span class="p">](</span><span class="nx">db</span><span class="p">)</span> <span class="k">if </span><span class="p">(</span><span class="nx">currentVersion</span> <span class="o">===</span> <span class="mi">0</span><span class="p">)</span> <span class="p">{</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">INSERT INTO schema_version (version) VALUES (?)</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="nx">version</span><span class="p">])</span> <span class="p">}</span> <span class="k">else</span> <span class="p">{</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">UPDATE schema_version SET version = ?</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="nx">version</span><span class="p">])</span> <span class="p">}</span> <span class="p">}</span> <span class="p">}</span> </code></pre> </div> <p>Run migrations immediately after initializing the database, before anything else touches it.</p> <h2> Serializing to Uint8Array </h2> <p>This is the key operation that makes everything else work. sql.js can export the entire database state as a <code>Uint8Array</code> — a binary blob that is identical to what SQLite would write to disk.<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">export</span> <span class="kd">function</span> <span class="nf">serializeDB</span><span class="p">()</span> <span class="p">{</span> <span class="k">return</span> <span class="nx">db</span><span class="p">.</span><span class="k">export</span><span class="p">()</span> <span class="c1">// Returns Uint8Array</span> <span class="p">}</span> </code></pre> </div> <p>That <code>Uint8Array</code> is your database file. Everything that follows — localStorage persistence, Drive upload, Drive download — is just moving that blob around.</p> <h2> localStorage persistence </h2> <p>After every write operation, serialize and save:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="kd">const</span> <span class="nx">DB_STORAGE_KEY</span> <span class="o">=</span> <span class="dl">'</span><span class="s1">otiq_db</span><span class="dl">'</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">saveDB</span><span class="p">()</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">buffer</span> <span class="o">=</span> <span class="nf">serializeDB</span><span class="p">()</span> <span class="c1">// Convert Uint8Array to a regular array for JSON serialisation</span> <span class="nx">localStorage</span><span class="p">.</span><span class="nf">setItem</span><span class="p">(</span><span class="nx">DB_STORAGE_KEY</span><span class="p">,</span> <span class="nx">JSON</span><span class="p">.</span><span class="nf">stringify</span><span class="p">(</span><span class="nb">Array</span><span class="p">.</span><span class="k">from</span><span class="p">(</span><span class="nx">buffer</span><span class="p">)))</span> <span class="c1">// Trigger the Drive upload debounce (see below)</span> <span class="nf">scheduleDriveUpload</span><span class="p">()</span> <span class="p">}</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">loadFromLocalStorage</span><span class="p">()</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">stored</span> <span class="o">=</span> <span class="nx">localStorage</span><span class="p">.</span><span class="nf">getItem</span><span class="p">(</span><span class="nx">DB_STORAGE_KEY</span><span class="p">)</span> <span class="k">if </span><span class="p">(</span><span class="o">!</span><span class="nx">stored</span><span class="p">)</span> <span class="k">return</span> <span class="kc">null</span> <span class="k">return</span> <span class="k">new</span> <span class="nc">Uint8Array</span><span class="p">(</span><span class="nx">JSON</span><span class="p">.</span><span class="nf">parse</span><span class="p">(</span><span class="nx">stored</span><span class="p">))</span> <span class="p">}</span> </code></pre> </div> <p>On app load, check localStorage first. If there's a saved buffer, restore from it. Then compare with Drive to decide whether to download a newer version.</p> <p><strong>Storage size note:</strong> A SQLite file with thousands of rows will likely stay well under 5MB — comfortably within localStorage limits. If your use case could grow very large, consider using the Origin Private File System instead, but for personal data tools localStorage is generally fine. Always call <code>navigator.storage.persist()</code> on first load to request durable storage — without it, browsers can evict localStorage under storage pressure.<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">requestDurableStorage</span><span class="p">()</span> <span class="p">{</span> <span class="k">if </span><span class="p">(</span><span class="nb">navigator</span><span class="p">.</span><span class="nx">storage</span> <span class="o">&&</span> <span class="nb">navigator</span><span class="p">.</span><span class="nx">storage</span><span class="p">.</span><span class="nx">persist</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">granted</span> <span class="o">=</span> <span class="k">await</span> <span class="nb">navigator</span><span class="p">.</span><span class="nx">storage</span><span class="p">.</span><span class="nf">persist</span><span class="p">()</span> <span class="k">if </span><span class="p">(</span><span class="o">!</span><span class="nx">granted</span><span class="p">)</span> <span class="p">{</span> <span class="c1">// Show a warning banner — Drive sync is the backup</span> <span class="nf">showStorageWarning</span><span class="p">()</span> <span class="p">}</span> <span class="p">}</span> <span class="p">}</span> </code></pre> </div> <h2> Google Drive as cloud sync </h2> <p>The Drive setup requires Google OAuth with the <code>drive.file</code> scope — the minimal scope that grants access only to files this specific app created. It cannot read other Drive files. This is the right choice for privacy-sensitive apps.</p> <p>I'll cover the full PKCE OAuth flow in the next article in this series. For now, assume you have a valid <code>access_token</code>.</p> <h3> Finding the database file </h3> <p>On login, search for an existing database file:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">findDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">response</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">fetch</span><span class="p">(</span> <span class="s2">`https://www.googleapis.com/drive/v3/files?q=name='overtimeiq.db'&fields=files(id,modifiedTime)`</span><span class="p">,</span> <span class="p">{</span> <span class="na">headers</span><span class="p">:</span> <span class="p">{</span> <span class="na">Authorization</span><span class="p">:</span> <span class="s2">`Bearer </span><span class="p">${</span><span class="nx">accessToken</span><span class="p">}</span><span class="s2">`</span> <span class="p">}</span> <span class="p">}</span> <span class="p">)</span> <span class="kd">const</span> <span class="nx">data</span> <span class="o">=</span> <span class="k">await</span> <span class="nx">response</span><span class="p">.</span><span class="nf">json</span><span class="p">()</span> <span class="k">return</span> <span class="nx">data</span><span class="p">.</span><span class="nx">files</span><span class="p">?.[</span><span class="mi">0</span><span class="p">]</span> <span class="o">??</span> <span class="kc">null</span> <span class="c1">// { id, modifiedTime } or null</span> <span class="p">}</span> </code></pre> </div> <h3> Creating the file (first time) </h3> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">createDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">dbBuffer</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">metadata</span> <span class="o">=</span> <span class="p">{</span> <span class="na">name</span><span class="p">:</span> <span class="dl">'</span><span class="s1">overtimeiq.db</span><span class="dl">'</span><span class="p">,</span> <span class="na">mimeType</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/octet-stream</span><span class="dl">'</span> <span class="p">}</span> <span class="kd">const</span> <span class="nx">formData</span> <span class="o">=</span> <span class="k">new</span> <span class="nc">FormData</span><span class="p">()</span> <span class="nx">formData</span><span class="p">.</span><span class="nf">append</span><span class="p">(</span><span class="dl">'</span><span class="s1">metadata</span><span class="dl">'</span><span class="p">,</span> <span class="k">new</span> <span class="nc">Blob</span><span class="p">([</span><span class="nx">JSON</span><span class="p">.</span><span class="nf">stringify</span><span class="p">(</span><span class="nx">metadata</span><span class="p">)],</span> <span class="p">{</span> <span class="na">type</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/json</span><span class="dl">'</span> <span class="p">}))</span> <span class="nx">formData</span><span class="p">.</span><span class="nf">append</span><span class="p">(</span><span class="dl">'</span><span class="s1">file</span><span class="dl">'</span><span class="p">,</span> <span class="k">new</span> <span class="nc">Blob</span><span class="p">([</span><span class="nx">dbBuffer</span><span class="p">],</span> <span class="p">{</span> <span class="na">type</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/octet-stream</span><span class="dl">'</span> <span class="p">}))</span> <span class="kd">const</span> <span class="nx">response</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">fetch</span><span class="p">(</span> <span class="dl">'</span><span class="s1">https://www.googleapis.com/upload/drive/v3/files?uploadType=multipart&fields=id</span><span class="dl">'</span><span class="p">,</span> <span class="p">{</span> <span class="na">method</span><span class="p">:</span> <span class="dl">'</span><span class="s1">POST</span><span class="dl">'</span><span class="p">,</span> <span class="na">headers</span><span class="p">:</span> <span class="p">{</span> <span class="na">Authorization</span><span class="p">:</span> <span class="s2">`Bearer </span><span class="p">${</span><span class="nx">accessToken</span><span class="p">}</span><span class="s2">`</span> <span class="p">},</span> <span class="na">body</span><span class="p">:</span> <span class="nx">formData</span> <span class="p">}</span> <span class="p">)</span> <span class="kd">const</span> <span class="nx">data</span> <span class="o">=</span> <span class="k">await</span> <span class="nx">response</span><span class="p">.</span><span class="nf">json</span><span class="p">()</span> <span class="k">return</span> <span class="nx">data</span><span class="p">.</span><span class="nx">id</span> <span class="c1">// Store this file ID in settings.drive_file_id</span> <span class="p">}</span> </code></pre> </div> <h3> Downloading the file </h3> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">downloadDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">fileId</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">response</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">fetch</span><span class="p">(</span> <span class="s2">`https://www.googleapis.com/drive/v3/files/</span><span class="p">${</span><span class="nx">fileId</span><span class="p">}</span><span class="s2">?alt=media`</span><span class="p">,</span> <span class="p">{</span> <span class="na">headers</span><span class="p">:</span> <span class="p">{</span> <span class="na">Authorization</span><span class="p">:</span> <span class="s2">`Bearer </span><span class="p">${</span><span class="nx">accessToken</span><span class="p">}</span><span class="s2">`</span> <span class="p">}</span> <span class="p">}</span> <span class="p">)</span> <span class="kd">const</span> <span class="nx">buffer</span> <span class="o">=</span> <span class="k">await</span> <span class="nx">response</span><span class="p">.</span><span class="nf">arrayBuffer</span><span class="p">()</span> <span class="k">return</span> <span class="k">new</span> <span class="nc">Uint8Array</span><span class="p">(</span><span class="nx">buffer</span><span class="p">)</span> <span class="p">}</span> </code></pre> </div> <h2> The sync decision logic </h2> <p>On every app load after login, you need to decide: use the local database, or download from Drive?<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">syncOnLogin</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">driveFile</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">findDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">)</span> <span class="k">if </span><span class="p">(</span><span class="o">!</span><span class="nx">driveFile</span><span class="p">)</span> <span class="p">{</span> <span class="c1">// First time — upload local DB and store the file ID</span> <span class="kd">const</span> <span class="nx">buffer</span> <span class="o">=</span> <span class="nf">loadFromLocalStorage</span><span class="p">()</span> <span class="o">??</span> <span class="nf">serializeDB</span><span class="p">()</span> <span class="kd">const</span> <span class="nx">fileId</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">createDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">buffer</span><span class="p">)</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">UPDATE settings SET drive_file_id = ? WHERE id = 1</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="nx">fileId</span><span class="p">])</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">UPDATE settings SET last_synced_at = ? WHERE id = 1</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="k">new</span> <span class="nc">Date</span><span class="p">().</span><span class="nf">toISOString</span><span class="p">()])</span> <span class="k">return</span> <span class="p">}</span> <span class="kd">const</span> <span class="nx">driveModifiedTime</span> <span class="o">=</span> <span class="k">new</span> <span class="nc">Date</span><span class="p">(</span><span class="nx">driveFile</span><span class="p">.</span><span class="nx">modifiedTime</span><span class="p">).</span><span class="nf">getTime</span><span class="p">()</span> <span class="kd">const</span> <span class="nx">localSyncedAt</span> <span class="o">=</span> <span class="nf">getOne</span><span class="p">(</span><span class="dl">'</span><span class="s1">SELECT last_synced_at FROM settings WHERE id = 1</span><span class="dl">'</span><span class="p">)?.</span><span class="nx">last_synced_at</span> <span class="kd">const</span> <span class="nx">localTime</span> <span class="o">=</span> <span class="nx">localSyncedAt</span> <span class="p">?</span> <span class="k">new</span> <span class="nc">Date</span><span class="p">(</span><span class="nx">localSyncedAt</span><span class="p">).</span><span class="nf">getTime</span><span class="p">()</span> <span class="p">:</span> <span class="mi">0</span> <span class="kd">const</span> <span class="nx">diff</span> <span class="o">=</span> <span class="nb">Math</span><span class="p">.</span><span class="nf">abs</span><span class="p">(</span><span class="nx">driveModifiedTime</span> <span class="o">-</span> <span class="nx">localTime</span><span class="p">)</span> <span class="k">if </span><span class="p">(</span><span class="nx">diff</span> <span class="o"><</span> <span class="mi">30</span><span class="nx">_000</span><span class="p">)</span> <span class="p">{</span> <span class="c1">// Within 30 seconds — same-device multi-tab edge case, no action</span> <span class="k">return</span> <span class="p">}</span> <span class="k">if </span><span class="p">(</span><span class="nx">driveModifiedTime</span> <span class="o">></span> <span class="nx">localTime</span><span class="p">)</span> <span class="p">{</span> <span class="c1">// Drive is newer — download and replace</span> <span class="kd">const</span> <span class="nx">buffer</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">downloadDBFile</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">driveFile</span><span class="p">.</span><span class="nx">id</span><span class="p">)</span> <span class="k">await</span> <span class="nf">reinitializeFromBuffer</span><span class="p">(</span><span class="nx">buffer</span><span class="p">)</span> <span class="c1">// Re-init sql.js with the new buffer</span> <span class="nf">showToast</span><span class="p">(</span><span class="dl">'</span><span class="s1">Synced from Drive</span><span class="dl">'</span><span class="p">)</span> <span class="p">}</span> <span class="k">else</span> <span class="p">{</span> <span class="c1">// Local is newer — upload</span> <span class="k">await</span> <span class="nf">uploadDBToDrive</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">driveFile</span><span class="p">.</span><span class="nx">id</span><span class="p">)</span> <span class="p">}</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">UPDATE settings SET last_synced_at = ? WHERE id = 1</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="k">new</span> <span class="nc">Date</span><span class="p">().</span><span class="nf">toISOString</span><span class="p">()])</span> <span class="p">}</span> </code></pre> </div> <p><strong>Conflict resolution policy:</strong> When in doubt, prefer the Drive copy. Drive is the source of truth. If <code>modifiedTime</code> comparison is inconclusive (e.g., clock skew between devices), take the Drive copy and show a toast: <em>"Synced from Drive — local changes from this session may have been overwritten."</em></p> <h2> The upload safety pattern </h2> <p>Never upload directly to <code>overtimeiq.db</code>. Upload to a temp file first, then rename atomically. A browser crash, network interruption, or error mid-upload should never corrupt the live database.<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">uploadDBToDrive</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">fileId</span><span class="p">)</span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">buffer</span> <span class="o">=</span> <span class="nf">serializeDB</span><span class="p">()</span> <span class="c1">// Step 1: Upload to temp file</span> <span class="kd">const</span> <span class="nx">tempMetadata</span> <span class="o">=</span> <span class="p">{</span> <span class="na">name</span><span class="p">:</span> <span class="dl">'</span><span class="s1">overtimeiq_tmp.db</span><span class="dl">'</span> <span class="p">}</span> <span class="kd">const</span> <span class="nx">formData</span> <span class="o">=</span> <span class="k">new</span> <span class="nc">FormData</span><span class="p">()</span> <span class="nx">formData</span><span class="p">.</span><span class="nf">append</span><span class="p">(</span><span class="dl">'</span><span class="s1">metadata</span><span class="dl">'</span><span class="p">,</span> <span class="k">new</span> <span class="nc">Blob</span><span class="p">([</span><span class="nx">JSON</span><span class="p">.</span><span class="nf">stringify</span><span class="p">(</span><span class="nx">tempMetadata</span><span class="p">)],</span> <span class="p">{</span> <span class="na">type</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/json</span><span class="dl">'</span> <span class="p">}))</span> <span class="nx">formData</span><span class="p">.</span><span class="nf">append</span><span class="p">(</span><span class="dl">'</span><span class="s1">file</span><span class="dl">'</span><span class="p">,</span> <span class="k">new</span> <span class="nc">Blob</span><span class="p">([</span><span class="nx">buffer</span><span class="p">],</span> <span class="p">{</span> <span class="na">type</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/octet-stream</span><span class="dl">'</span> <span class="p">}))</span> <span class="kd">const</span> <span class="nx">uploadResponse</span> <span class="o">=</span> <span class="k">await</span> <span class="nf">fetch</span><span class="p">(</span> <span class="s2">`https://www.googleapis.com/upload/drive/v3/files/</span><span class="p">${</span><span class="nx">fileId</span><span class="p">}</span><span class="s2">?uploadType=multipart`</span><span class="p">,</span> <span class="p">{</span> <span class="na">method</span><span class="p">:</span> <span class="dl">'</span><span class="s1">PATCH</span><span class="dl">'</span><span class="p">,</span> <span class="na">headers</span><span class="p">:</span> <span class="p">{</span> <span class="na">Authorization</span><span class="p">:</span> <span class="s2">`Bearer </span><span class="p">${</span><span class="nx">accessToken</span><span class="p">}</span><span class="s2">`</span> <span class="p">},</span> <span class="na">body</span><span class="p">:</span> <span class="nx">formData</span> <span class="p">}</span> <span class="p">)</span> <span class="k">if </span><span class="p">(</span><span class="o">!</span><span class="nx">uploadResponse</span><span class="p">.</span><span class="nx">ok</span><span class="p">)</span> <span class="k">throw</span> <span class="k">new</span> <span class="nc">Error</span><span class="p">(</span><span class="dl">'</span><span class="s1">Upload failed</span><span class="dl">'</span><span class="p">)</span> <span class="c1">// Step 2: Rename temp file to live file atomically</span> <span class="k">await</span> <span class="nf">fetch</span><span class="p">(</span> <span class="s2">`https://www.googleapis.com/drive/v3/files/</span><span class="p">${</span><span class="nx">fileId</span><span class="p">}</span><span class="s2">`</span><span class="p">,</span> <span class="p">{</span> <span class="na">method</span><span class="p">:</span> <span class="dl">'</span><span class="s1">PATCH</span><span class="dl">'</span><span class="p">,</span> <span class="na">headers</span><span class="p">:</span> <span class="p">{</span> <span class="na">Authorization</span><span class="p">:</span> <span class="s2">`Bearer </span><span class="p">${</span><span class="nx">accessToken</span><span class="p">}</span><span class="s2">`</span><span class="p">,</span> <span class="dl">'</span><span class="s1">Content-Type</span><span class="dl">'</span><span class="p">:</span> <span class="dl">'</span><span class="s1">application/json</span><span class="dl">'</span> <span class="p">},</span> <span class="na">body</span><span class="p">:</span> <span class="nx">JSON</span><span class="p">.</span><span class="nf">stringify</span><span class="p">({</span> <span class="na">name</span><span class="p">:</span> <span class="dl">'</span><span class="s1">overtimeiq.db</span><span class="dl">'</span> <span class="p">})</span> <span class="p">}</span> <span class="p">)</span> <span class="p">}</span> </code></pre> </div> <p>If Step 1 succeeds but Step 2 fails, the user has a temp file but the live file is intact. On the next sync, the timestamp comparison will catch the discrepancy and prompt a re-upload.</p> <h2> Debouncing the Drive upload </h2> <p>You don't want to upload to Drive on every keypress or every individual log entry mutation. Debounce it:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="kd">let</span> <span class="nx">driveUploadTimeout</span> <span class="o">=</span> <span class="kc">null</span> <span class="k">export</span> <span class="kd">function</span> <span class="nf">scheduleDriveUpload</span><span class="p">()</span> <span class="p">{</span> <span class="k">if </span><span class="p">(</span><span class="nx">driveUploadTimeout</span><span class="p">)</span> <span class="nf">clearTimeout</span><span class="p">(</span><span class="nx">driveUploadTimeout</span><span class="p">)</span> <span class="nx">driveUploadTimeout</span> <span class="o">=</span> <span class="nf">setTimeout</span><span class="p">(</span><span class="k">async </span><span class="p">()</span> <span class="o">=></span> <span class="p">{</span> <span class="kd">const</span> <span class="nx">accessToken</span> <span class="o">=</span> <span class="nf">getAccessToken</span><span class="p">()</span> <span class="c1">// From your auth store</span> <span class="kd">const</span> <span class="nx">fileId</span> <span class="o">=</span> <span class="nf">getOne</span><span class="p">(</span><span class="dl">'</span><span class="s1">SELECT drive_file_id FROM settings WHERE id = 1</span><span class="dl">'</span><span class="p">)?.</span><span class="nx">drive_file_id</span> <span class="k">if </span><span class="p">(</span><span class="nx">accessToken</span> <span class="o">&&</span> <span class="nx">fileId</span><span class="p">)</span> <span class="p">{</span> <span class="k">await</span> <span class="nf">uploadDBToDrive</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">,</span> <span class="nx">fileId</span><span class="p">)</span> <span class="nf">execSQL</span><span class="p">(</span><span class="dl">'</span><span class="s1">UPDATE settings SET last_synced_at = ? WHERE id = 1</span><span class="dl">'</span><span class="p">,</span> <span class="p">[</span><span class="k">new</span> <span class="nc">Date</span><span class="p">().</span><span class="nf">toISOString</span><span class="p">()])</span> <span class="p">}</span> <span class="p">},</span> <span class="mi">10</span><span class="nx">_000</span><span class="p">)</span> <span class="c1">// 10 seconds after the last write</span> <span class="p">}</span> </code></pre> </div> <p>The localStorage write happens synchronously on every mutation — data is safe locally the instant you write it. The Drive upload is fire-and-forget with a 10-second debounce so a bulk import (100 rows at once) only triggers one upload.</p> <h2> Putting it all together </h2> <p>The initialization sequence on app load:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight javascript"><code><span class="k">async</span> <span class="kd">function</span> <span class="nf">initializeApp</span><span class="p">()</span> <span class="p">{</span> <span class="c1">// 1. Try to restore from localStorage</span> <span class="kd">const</span> <span class="nx">storedBuffer</span> <span class="o">=</span> <span class="nf">loadFromLocalStorage</span><span class="p">()</span> <span class="c1">// 2. Initialize sql.js with the stored buffer (or fresh)</span> <span class="k">await</span> <span class="nf">initDB</span><span class="p">(</span><span class="nx">storedBuffer</span><span class="p">)</span> <span class="c1">// 3. Run schema migrations</span> <span class="k">await</span> <span class="nf">runMigrations</span><span class="p">(</span><span class="nx">db</span><span class="p">)</span> <span class="c1">// 4. Seed defaults if this is the first launch</span> <span class="k">if </span><span class="p">(</span><span class="o">!</span><span class="nf">getOne</span><span class="p">(</span><span class="dl">'</span><span class="s1">SELECT id FROM jobs WHERE id = 1</span><span class="dl">'</span><span class="p">))</span> <span class="p">{</span> <span class="nf">seedDefaultJob</span><span class="p">()</span> <span class="nf">seedHolidays</span><span class="p">()</span> <span class="p">}</span> <span class="c1">// 5. Request durable storage</span> <span class="k">await</span> <span class="nf">requestDurableStorage</span><span class="p">()</span> <span class="c1">// 6. If authenticated, sync with Drive</span> <span class="kd">const</span> <span class="nx">accessToken</span> <span class="o">=</span> <span class="nf">getStoredAccessToken</span><span class="p">()</span> <span class="k">if </span><span class="p">(</span><span class="nx">accessToken</span><span class="p">)</span> <span class="p">{</span> <span class="k">await</span> <span class="nf">syncOnLogin</span><span class="p">(</span><span class="nx">accessToken</span><span class="p">)</span> <span class="p">}</span> <span class="p">}</span> </code></pre> </div> <h2> What this doesn't cover </h2> <p>This article focused on the storage and sync layer. Two things worth a separate deep dive:</p> <p><strong>The Google OAuth PKCE flow</strong> — how to get the <code>access_token</code> and <code>refresh_token</code> without a client secret, and how to silently refresh the token mid-session. That's the next article in this series.</p> <p><strong>The midnight rate calculation</strong> — how to correctly split a shift that crosses midnight across two different rate multipliers, including the December 31 → January 1 edge case. I'll cover that in a later article on the earnings engine.</p> <h2> The case for this architecture </h2> <p>The pattern here — SQLite on the user's cloud storage, managed entirely client-side — works well for a specific category of app: personal data tools where the data is sensitive, the user count is small, and data portability is a first-class feature.</p> <p>It's not the right choice for collaborative tools, apps with large binary assets, or anything requiring server-side processing of the data. But for personal productivity software, financial tracking, health logging, or any domain where "your data should be yours" is a meaningful promise — this architecture delivers it genuinely, not as marketing copy.</p> <p>The database is a file. The user can open it in DB Browser for SQLite today. They'll be able to open it in twenty years. That kind of portability is hard to promise with any other approach.</p> <p><em>I'm building <a href="https://overtimeiq.vercel.app?ref=devto" rel="noopener noreferrer">OvertimeIQ</a> — a personal overtime tracker where your data lives on your own Google Drive. This is part of an ongoing series documenting the technical decisions behind the build. The <a href="https://dev.to/deeshansharma/i-tried-to-build-a-personal-saas-with-zero-backend-heres-where-that-strategy-hits-a-wall-210i">first article in the series</a> covers the overall architecture and where the "no backend" approach hits a ceiling.</em></p>
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。