https://waylonwalker.com/tags/duckdb/atom.xml 2023-07-31T22:36:12Z All posts with the tag "duckdb" Waylon Walker markata-go https://waylonwalker.com/thought-63/ 2023-07-31T22:36:12Z 2023-07-31T22:36:12Z

!https://kestra.io/blogs/2023-07-28-duckdb-vs-motherduck

<div class="embed-card embed-card-external"> <a href="https://kestra.io/blogs/2023-07-28-duckdb-vs-motherduck" class="embed-card-link" target="_blank" rel="noopener noreferrer"> <div class="embed-card-image"> <img class="glightbox" src="https://kestra.io/cdn-cgi/image/onerror=redirect,width=1201,height=676,format=webp/_astro/main.BpltYTV4.png" alt="DuckDB vs. MotherDuck — should you switch to the cloud version? | Kestra — Why and when to use MotherDuck over local DuckDB" loading="lazy"/ data-glightbox="description: DuckDB vs. MotherDuck — should you switch to the cloud version? | Kestra — Why and when to use MotherDuck over local DuckDB"> </div> <div class="embed-card-content"> <div class="embed-card-title">DuckDB vs. MotherDuck — should you switch to the cloud version? | Kestra</div> <div class="embed-card-description">Why and when to use MotherDuck over local DuckDB</div> <div class="embed-card-meta">kestra.io</div> </div> </a> </div> <p>duckdb is a new in process database that has been making its rounds in analytics for its high performance in those applications.</p> <p>Mother duck is a centeralized server that brings manages storage, data sharing and an ide to duckdb.</p> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This post is a <a href="/thoughts/" class="wikilink" data-title="Thoughts" data-description="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my..." data-date="2024-04-01" data-preview="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my...">thought</a>. It’s a short note that I make about someone else’s content online <a href="/tags/thoughts/" class="hashtag-tag" data-tag="thoughts" data-count="2" data-reading-time="3" data-reading-time-text="3 minutes">#thoughts</a></p> </div> Waylon Walker hello@waylonwalker.com https://waylonwalker.com https://waylonwalker.com/thought-35/ 2023-07-28T14:59:37Z 2023-07-28T14:59:37Z

!https://duckdb.org/docs/guides/sql_editors/harlequin

<div class="embed-card embed-card-external"> <a href="https://duckdb.org/docs/guides/sql_editors/harlequin" class="embed-card-link has-avatar has-avatar-before" target="_blank" rel="noopener noreferrer" style="--favicon-url: url(&#39;/assets/markata/link-avatars/duckdb.org.png&#39;);" data-favicon="/assets/markata/link-avatars/duckdb.org.png"> <div class="embed-card-content"> <div class="embed-card-title">External Link</div> <div class="embed-card-meta">duckdb.org</div> </div> </a> </div> <p>Harlequin is a pretty sweet example of what textual can be used to create. Its a terminal based sql ide for DuckDB.</p> <div class="admonition note"> <p class="admonition-title">Note</p> <p>This post is a <a href="/thoughts/" class="wikilink" data-title="Thoughts" data-description="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my..." data-date="2024-04-01" data-preview="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my...">thought</a>. It’s a short note that I make about someone else’s content online <a href="/tags/thoughts/" class="hashtag-tag" data-tag="thoughts" data-count="2" data-reading-time="3" data-reading-time-text="3 minutes">#thoughts</a></p> </div> Waylon Walker hello@waylonwalker.com https://waylonwalker.com https://waylonwalker.com/thought-34/ 2023-07-28T14:59:37Z 2023-07-28T14:59:37Z

!https://duckdb.org/docs/api/python/overview.html

<figure> <a href="/static/https://duckdb.org/docs/api/python/overview.html" class="glightbox-link"><img class="glightbox" src="/static/https://duckdb.org/docs/api/python/overview.html" alt="https://duckdb.org/docs/api/python/overview.html"/ data-glightbox="description: https://duckdb.org/docs/api/python/overview.html"></a> </figure> <p>To persist data in duckdb you need to first make a connection to a duck db database.</p> <pre class="chroma"><code><span class="line"><span class="cl"><span class="n">con</span> <span class="o">=</span> <span class="n">duckdb</span><span class="o">.</span><span class="n">connect</span><span class="p">(</span><span class="s1">&#39;file.db&#39;</span><span class="p">)</span> </span></span></code></pre><p>Then work off of the connection <code>con</code> rather than <code>duckdb</code>.</p> <pre class="chroma"><code><span class="line"><span class="cl"><span class="n">con</span><span class="o">.</span><span class="n">sql</span><span class="p">(</span><span class="s1">&#39;CREATE TABLE test(i INTEGER)&#39;</span><span class="p">)</span> </span></span><span class="line"><span class="cl"><span class="n">con</span><span class="o">.</span><span class="n">sql</span><span class="p">(</span><span class="s1">&#39;INSERT INTO test VALUES (42)&#39;</span><span class="p">)</span> </span></span><span class="line"><span class="cl"><span class="c1"># query the table</span> </span></span><span class="line"><span class="cl"><span class="n">con</span><span class="o">.</span><span class="n">table</span><span class="p">(</span><span class="s1">&#39;test&#39;</span><span class="p">)</span><span class="o">.</span><span class="n">show</span><span class="p">()</span> </span></span><span class="line"><span class="cl"><span class="c1"># explicitly close the connection</span> </span></span><span class="line"><span class="cl"><span class="n">con</span><span class="o">.</span><span class="n">close</span><span class="p">()</span> </span></span></code></pre><div class="admonition note"> <p class="admonition-title">Note</p> <p>This post is a <a href="/thoughts/" class="wikilink" data-title="Thoughts" data-description="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my..." data-date="2024-04-01" data-preview="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my...">thought</a>. It’s a short note that I make about someone else’s content online <a href="/tags/thoughts/" class="hashtag-tag" data-tag="thoughts" data-count="2" data-reading-time="3" data-reading-time-text="3 minutes">#thoughts</a></p> </div> Waylon Walker hello@waylonwalker.com https://waylonwalker.com https://waylonwalker.com/thought-33/ 2023-07-28T14:59:37Z 2023-07-28T14:59:37Z

!https://duckdb.org/docs/guides/python/sql_pandas

<div class="embed-card embed-card-external"> <a href="https://duckdb.org/docs/guides/python/sql_on_pandas" class="embed-card-link has-avatar has-avatar-before" target="_blank" rel="noopener noreferrer" style="--favicon-url: url(&#39;/assets/markata/link-avatars/duckdb.org.png&#39;);" data-favicon="/assets/markata/link-avatars/duckdb.org.png"> <div class="embed-card-content"> <div class="embed-card-title">Redirecting…</div> <div class="embed-card-meta">duckdb.org</div> </div> </a> </div> <p>duckdb can just query any pandas dataframe that is in memory.</p> <blockquote> <p>I tried running it against a list of objects and got this error. Great error message that gives me supported types right in the message.</p> </blockquote> <pre class="chroma"><code><span class="line"><span class="cl"><span class="n">Make</span> <span class="n">sure</span> <span class="n">that</span> <span class="s2">&#34;posts&#34;</span> <span class="ow">is</span> <span class="n">either</span> <span class="n">a</span> <span class="n">pandas</span><span class="o">.</span><span class="n">DataFrame</span><span class="p">,</span> <span class="n">duckdb</span><span class="o">.</span><span class="n">DuckDBPyRelation</span><span class="p">,</span> <span class="n">pyarrow</span> <span class="n">Table</span><span class="p">,</span> <span class="n">Dataset</span><span class="p">,</span> <span class="n">RecordBatchReader</span><span class="p">,</span> <span class="n">Scanner</span><span class="p">,</span> <span class="ow">or</span> <span class="n">NumPy</span> <span class="n">ndarrays</span> <span class="k">with</span> <span class="n">supported</span> <span class="nb">format</span> </span></span></code></pre><div class="admonition note"> <p class="admonition-title">Note</p> <p>This post is a <a href="/thoughts/" class="wikilink" data-title="Thoughts" data-description="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my..." data-date="2024-04-01" data-preview="These are generally my thoughts on a web page or some sort of url, except a rare few don&#39;t have a link. These are dual published off of my...">thought</a>. It’s a short note that I make about someone else’s content online <a href="/tags/thoughts/" class="hashtag-tag" data-tag="thoughts" data-count="2" data-reading-time="3" data-reading-time-text="3 minutes">#thoughts</a></p> </div> Waylon Walker hello@waylonwalker.com https://waylonwalker.com