<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom" xmlns:mosaic="tag:silasjelley.com,2026:mosaic-feed">

<title>Silas Jelley&#39;s Corner of the Web / Tinkering</title>
<link rel="self" type="application/atom+xml" href="https://silasjelley.com/feeds/tinkering" />
<link href="https://silasjelley.com/" />
<id>https://silasjelley.com/feeds/tinkering/</id>
<icon>/icon/48.ico</icon>
<author>
  <name>Silas Jelley</name>
  <email>reply@silasjelley.com</email>
</author>

<updated>2026-04-01T17:30:52+05:00</updated>
<entry>
  <title>Quick notes search with Fish Shell, fzf, and ripgrep</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/fish-fzf-notes-search" />
  <id>tag:silasjelley.com,2020-08-20:f7fed726-3abf-42c5-9e66-74c1f899ba1a</id>
  <published>2025-10-24T12:13:18+04:00</published>
  <updated>2025-10-24T12:13:18+04:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>Switching from ZSH to Fish Shell has had me migrating/rewriting shell functions that I use frequently. Near the top of the list of my most essential shell functions: interactive searching of my…</summary>
<mosaic:place>Astrakhan, Astrakhan Oblast, Russia</mosaic:place>
<content type="html">
    &lt;p&gt;Switching from &lt;code&gt;ZSH&lt;/code&gt; to &lt;a href=&#34;https://fishshell.com/&#34;&gt;Fish Shell&lt;/a&gt; has had me migrating/rewriting shell functions that I use frequently. Near the top of the list of my most essential shell functions: interactive searching of my notes. I’ve been using a shell function like this for years, but the switch to fish gave me a good excuse to make a few tweaks.&lt;/p&gt;&lt;p&gt;The core idea is simple: search through my notes with &lt;code&gt;ripgrep&lt;/code&gt;, filter interactively with &lt;code&gt;fzf&lt;/code&gt;, and jump to the matching line in my editor. What makes it nice is the &lt;code&gt;bat&lt;/code&gt; preview window showing context around each match as I navigate through results.&lt;/p&gt;&lt;p&gt;The fish version is cleaner than my old ZSH one, which is pretty much how I’d sum-up my entire experience switching to fish: &lt;em&gt;everything is just a little cleaner and more joyful&lt;/em&gt;. Fish’s &lt;code&gt;argparse&lt;/code&gt; makes handling options actually pleasant (if a teeny-bit verbose…), so I added flags for &lt;code&gt;--direction&lt;/code&gt;, file &lt;code&gt;--extension&lt;/code&gt;, and &lt;code&gt;--language&lt;/code&gt; for syntax highlighting in &lt;code&gt;bat&lt;/code&gt;. Probably the biggest change is that I’ve made the function default to &lt;em&gt;not&lt;/em&gt; opening the file, instead it assembles the command to open the file in the command buffer so I can see it, but won’t trigger until I hit Enter. This frees me to use the function to pick out a file path, but then tweak the prepared command (say, swap &lt;code&gt;\$EDITOR&lt;/code&gt; for &lt;code&gt;rm&lt;/code&gt; if I actually want to delete the file) before running it if needed.&lt;/p&gt;&lt;p&gt;If I do just want to jump in though, I included an &lt;code&gt;--execute&lt;/code&gt; flag that opens the editor immediately instead of just staging the command in my buffer, and I have an alias for this.&lt;/p&gt;&lt;p&gt;Speaking of alias’s, I’ve set up a few for searching the different file-types and directories I’m always flitting through: notes, journal, and manifests. They’re just thin wrappers, but they’re what I’ll be typing dozens of times a day, so brevity is welcome. The full function with its options is there when I need it, but usually I just want to search my notes and these make that seamless.&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;fish&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;fish&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;fish&#34;&gt;&lt;span style=&#34;color: #d73948&#34;&gt;function&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;sn&lt;/span&gt; --wraps search-notes --description &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Search notes (short alias)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;search-notes&lt;/span&gt; --directory &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;/notes --extension md --language toml $argv
end

function sm --wraps search-notes --description &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Search manifests (short alias)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;search-notes&lt;/span&gt; --directory &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;/records/manifests --extension toml --language toml $argv
end

function sj --wraps search-notes --description &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Search manifests (short alias)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;search-notes&lt;/span&gt; --directory &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;/journal --extension toml --language toml $argv
end&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Here’s the actual script:&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;fish&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;fish&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;fish&#34;&gt;&lt;span style=&#34;color: #d73948&#34;&gt;function&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;search-notes&lt;/span&gt; --description &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Search notes with ripgrep and fzf, open in editor&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Default values&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l dir &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;/notes
    &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l ext md
    &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l lang toml
    &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l execute &lt;span style=&#34;color: #b60157&#34;&gt;0&lt;/span&gt;

    &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Parse options&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;argparse&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;d/directory=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;e/extension=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;l/language=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; x/execute -- $argv
    or return

    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -q _flag_directory
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; dir $_flag_directory
    end
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -q _flag_extension
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; ext $_flag_extension
    end
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -q _flag_language
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; lang $_flag_language
    end
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -q _flag_execute
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; execute &lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;end&lt;/span&gt;

    &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Perform the search&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l selected (&lt;span style=&#34;color: #4b69c6&#34;&gt;rg&lt;/span&gt; --color=always --line-number --no-heading --smart-case --glob &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;*.&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;ext&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; $dir &lt;span style=&#34;color: #1d6c76&#34;&gt;\&lt;/span&gt;
        | &lt;span style=&#34;color: #4b69c6&#34;&gt;fzf&lt;/span&gt; --ansi &lt;span style=&#34;color: #1d6c76&#34;&gt;\&lt;/span&gt;
              &lt;span style=&#34;color: #4b69c6&#34;&gt;--exact&lt;/span&gt; &lt;span style=&#34;color: #1d6c76&#34;&gt;\&lt;/span&gt;
              &lt;span style=&#34;color: #4b69c6&#34;&gt;--delimiter&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #1d6c76&#34;&gt;\&lt;/span&gt;
              &lt;span style=&#34;color: #4b69c6&#34;&gt;--preview&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;bat --color=always --language=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;lang&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt; --highlight-line {2} {1}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; &lt;span style=&#34;color: #1d6c76&#34;&gt;\&lt;/span&gt;
              &lt;span style=&#34;color: #4b69c6&#34;&gt;--preview-window&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;up,60%,border-bottom,+{2}+3/3,~3&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)

    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;test&lt;/span&gt; -n &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;selected&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l file (&lt;span style=&#34;color: #4b69c6&#34;&gt;echo&lt;/span&gt; $selected &lt;span style=&#34;color: #d73948&#34;&gt;|&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;cut&lt;/span&gt; -d: -f1)
        &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt; -l line (&lt;span style=&#34;color: #4b69c6&#34;&gt;echo&lt;/span&gt; $selected &lt;span style=&#34;color: #d73948&#34;&gt;|&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;cut&lt;/span&gt; -d: -f2)

        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;test&lt;/span&gt; $execute -eq &lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Directly execute the editor command&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;eval&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;e +&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;line&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt; &lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;file&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        else
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Insert into commandline buffer (default behavior)&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;commandline&lt;/span&gt; -r &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;e +&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;line&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt; &lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;file&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;end&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;end&lt;/span&gt;
&lt;span style=&#34;color: #d73948&#34;&gt;end&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;12:13pm on October 24, 2025 from Astrakhan, Astrakhan Oblast, Russia&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CQuick%20notes%20search%20with%20Fish%20Shell%2C%20fzf%2C%20and%20ripgrep%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>Wrestling Calibre to organise books my way</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/wrestling-calibre" />
  <id>tag:silasjelley.com,2020-08-20:ff3b1965-7e63-4c5e-b8cd-bf6a8248c53e</id>
  <published>2025-08-19T18:45:41+04:00</published>
  <updated>2025-08-19T18:45:41+04:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>I’ve always been annoyed by the way Calibre organises ebooks. Today I decided to dig into its export templating syntax though, and I’ve come up with something I’m happy with. As with MusicBrainz…</summary>
<mosaic:place>Tbilisi, Georgia</mosaic:place>
<content type="html">
    &lt;p&gt;I’ve always been annoyed by the way Calibre organises ebooks. Today I decided to dig into its export templating syntax though, and I’ve come up with something I’m happy with. As with &lt;a href=&#34;/picard-folders&#34; title=&#34;A sensible folder hierarchy for MusicBrainz Picard | July 2025&#34; data-preview=&#34;/previews/5ed5ef9b-15e8-4d04-a5d4-a698c70c6030.html&#34;&gt;MusicBrainz previously&lt;/a&gt;, I’m preserving this here so I never have to fiddle with its arcane syntax again!&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;sh&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;sh&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;sh&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;program:&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;first_author&lt;/span&gt; = list_item(field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,0,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;author&lt;/span&gt;    = re(re(re(re(re(re(re(re( first_author, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\.&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;and&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;^\s+|\s+$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\[\]\(\)\{\}]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;title&lt;/span&gt;     = re(re(re(re(re(re(re( field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;title&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;       &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;And&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;^\s+|\s+$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\[\]\(\)\{\}]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher&lt;/span&gt; = re(re(re(re(re(re(re( field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;publisher&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;   &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;And&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;^\s+|\s+$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\[\]\(\)\{\}]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;year&lt;/span&gt;      = format_date(field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;pubdate&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;yyyy&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;
    &lt;span style=&#34;color: #4b69c6&#34;&gt;titleyear&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;year&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;

    &lt;span style=&#34;color: #4b69c6&#34;&gt;series_part&lt;/span&gt; = test(
        &lt;span style=&#34;color: #4b69c6&#34;&gt;field&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;re&lt;/span&gt;(re(re(re(re(re(re( field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;And&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;^\s+|\s+$&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\[\]\(\)\{\}]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)
        &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;format_number&lt;/span&gt;(field(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series_index&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;0&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;
    )&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;

    &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher_part&lt;/span&gt; = test(
        &lt;span style=&#34;color: #4b69c6&#34;&gt;field&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;publisher&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt;
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher,&lt;/span&gt;
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;
    )&lt;span style=&#34;color: #d73948&#34;&gt;;&lt;/span&gt;

    &lt;span style=&#34;color: #4b69c6&#34;&gt;author&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;year&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;series_part&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;title&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;titleyear&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;&amp;amp;&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher_part&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Of course, just as soon as I’m done fiddling I learn that Calibre also supports Python templating, so I’ve since rewritten in its far preferable syntax and expanded it to cover a lot more edge cases. The code is pretty straightforward.&lt;/p&gt;&lt;p&gt;NOTE: The &lt;code&gt;python:&lt;/code&gt; at the beginning is a necessary sigil for Calibre to enter &lt;a href=&#34;https://manual.calibre-ebook.com/template_lang.html#python-template-mode&#34;&gt;Python Template Mode&lt;/a&gt;.&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;python&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;python&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;python&#34;&gt;python:
&lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;evaluate&lt;/span&gt;(book, context):
    &lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; re
    &lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; ast

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;clean&lt;/span&gt;(s):
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;not&lt;/span&gt; s:
            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        s &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;and&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;(s))
        s &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\.&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\[&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\]&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\(&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\)&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\{&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\}&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;:,&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
        s &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\\&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;/&amp;lt;&amp;gt;|?*&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
        s &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;\s&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s.&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;())
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #d73948&#34;&gt;lambda&lt;/span&gt; m: m.&lt;span style=&#34;color: #4b69c6&#34;&gt;group&lt;/span&gt;()[&lt;span style=&#34;color: #b60157&#34;&gt;0&lt;/span&gt;], s).&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;first_author_name&lt;/span&gt;(book):
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; a_sort &lt;span style=&#34;color: #d73948&#34;&gt;:=&lt;/span&gt; (book.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;author_sort&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;or&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;).&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;():
            first &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;split&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;\s&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;*&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;&amp;amp;;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;\s&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;*&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;|&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;\s&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;and&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;\s&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, a_sort)[&lt;span style=&#34;color: #b60157&#34;&gt;0&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;()
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; first:
                last, firsts &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; [p.&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;() &lt;span style=&#34;color: #d73948&#34;&gt;for&lt;/span&gt; p &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; first.&lt;span style=&#34;color: #4b69c6&#34;&gt;split&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;)]
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;firsts&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt; &lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;last&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;()
            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; first

    &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Build components&lt;/span&gt;
    author_clean &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;clean&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;first_author_name&lt;/span&gt;(book) &lt;span style=&#34;color: #d73948&#34;&gt;or&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Unknown&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
    title &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;clean&lt;/span&gt;(book.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;title&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;))
    publisher &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;clean&lt;/span&gt;(book.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;publisher&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;))

    year &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; pubdate &lt;span style=&#34;color: #d73948&#34;&gt;:=&lt;/span&gt; book.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;pubdate&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;):
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;hasattr&lt;/span&gt;(pubdate, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;strftime&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;and&lt;/span&gt; (y &lt;span style=&#34;color: #d73948&#34;&gt;:=&lt;/span&gt; pubdate.&lt;span style=&#34;color: #4b69c6&#34;&gt;strftime&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%Y&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)).&lt;span style=&#34;color: #4b69c6&#34;&gt;isdigit&lt;/span&gt;() &lt;span style=&#34;color: #d73948&#34;&gt;and&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;int&lt;/span&gt;(y) &lt;span style=&#34;color: #d73948&#34;&gt;&amp;gt;=&lt;/span&gt; &lt;span style=&#34;color: #b60157&#34;&gt;1000&lt;/span&gt;:
            year &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; y

    series_part &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; series &lt;span style=&#34;color: #d73948&#34;&gt;:=&lt;/span&gt; book.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;):
        series_part &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;clean&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;series&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;int&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;book&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series_index&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt; &lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;0&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;:0d&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

    &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Assemble path&lt;/span&gt;
    path &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;author_clean&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; year:
        path &lt;span style=&#34;color: #d73948&#34;&gt;+=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;year&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    path &lt;span style=&#34;color: #d73948&#34;&gt;+=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;series_part&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;title&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; year:
        path &lt;span style=&#34;color: #d73948&#34;&gt;+=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;year&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; publisher:
        path &lt;span style=&#34;color: #d73948&#34;&gt;+=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;publisher&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

    &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; re.&lt;span style=&#34;color: #4b69c6&#34;&gt;sub&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #d73948&#34;&gt;lambda&lt;/span&gt; m: m.&lt;span style=&#34;color: #4b69c6&#34;&gt;group&lt;/span&gt;()[&lt;span style=&#34;color: #b60157&#34;&gt;0&lt;/span&gt;], path).&lt;span style=&#34;color: #4b69c6&#34;&gt;strip&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Things weren’t as easy and smooth as they could have been however. After banging my head against the wall for nearly an hour, having got my python script to exactly* where I wanted it, there emerged a persistent bug wherein one of my variables was returning an unexpected value for no discernible reason…&lt;/p&gt;&lt;p&gt;I found the cause. For no bloody good reason, Kovid Goyal, the &lt;s&gt;benevolant&lt;/s&gt; dictator of Calibre has opted to run a couple of arbitrary string replaces on custom templates at runtime. Buried in a 464 line python file installed by Calibre at &lt;code&gt;/usr/lib/calibre/calibre/library/save_to_disk.py&lt;/code&gt; is this function:&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;python&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;python&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;python&#34;&gt;&lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;preprocess_template&lt;/span&gt;(template):
    template &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; template.&lt;span style=&#34;color: #4b69c6&#34;&gt;replace&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;//&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)
    template &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; template.&lt;span style=&#34;color: #4b69c6&#34;&gt;replace&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;author&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)
    template &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; template.&lt;span style=&#34;color: #4b69c6&#34;&gt;replace&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;tag&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;tags&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)
    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;not&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;isinstance&lt;/span&gt;(template, &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;):
        template &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; template.&lt;span style=&#34;color: #4b69c6&#34;&gt;decode&lt;/span&gt;(preferred_encoding, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;replace&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)
    &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; template
&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;WHAT! Why are you replacing strings in a user’s template Kovid?! What’s most insidious about it is he’s not replacing &lt;code&gt;author&lt;/code&gt;, but &lt;code&gt;{author}&lt;/code&gt; so this bug only bites you if you use an &lt;code&gt;author&lt;/code&gt; variable inside an f-string (eg &lt;code&gt;path = f&amp;#34;{author}/{year}&amp;#34;&lt;/code&gt; in my case).&lt;/p&gt;&lt;p&gt;Now I know the source of this weird feckin bug, it’s a trivial fix: rename my &lt;code&gt;author&lt;/code&gt; variable to &lt;em&gt;anything else&lt;/em&gt;, I went with &lt;code&gt;author_clean&lt;/code&gt;. Bugger me.&lt;/p&gt;&lt;details&gt;&lt;summary&gt;&lt;strong&gt;Click here&lt;/strong&gt; (future me) for the full error that eventually led me back to the source of this mayhem.&lt;/summary&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;sh&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;sh&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;sh&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;calibre,&lt;/span&gt; version 8.7.0
&lt;span style=&#34;color: #4b69c6&#34;&gt;ERROR:&lt;/span&gt; Error while saving: Failed to save any books to disk, click &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Show details&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; for more information

&lt;span style=&#34;color: #4b69c6&#34;&gt;Failed&lt;/span&gt; to save: Confessions of an English Opium-Eater by Thomas De Quincey to disk, with error:
    &lt;span style=&#34;color: #4b69c6&#34;&gt;Traceback&lt;/span&gt; (most recent call last)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/utils/formatter.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 1770, in _run_python_template
        &lt;span style=&#34;color: #4b69c6&#34;&gt;rslt&lt;/span&gt; = compiled_template(self.book, self.python_context_object)
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\&amp;lt;string&amp;gt;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 94, in evaluate
    &lt;span style=&#34;color: #4b69c6&#34;&gt;NameError:&lt;/span&gt; name &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; is not defined. Did you mean: &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;author&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;?&lt;/span&gt;

    &lt;span style=&#34;color: #4b69c6&#34;&gt;During&lt;/span&gt; handling of the above exception, another exception occurred:

    &lt;span style=&#34;color: #4b69c6&#34;&gt;Traceback&lt;/span&gt; (most recent call last)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/library/save_to_disk.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 286, in get_path_components
        &lt;span style=&#34;color: #4b69c6&#34;&gt;components&lt;/span&gt; = get_components(opts.template, mi, book_id, opts.timefmt, path_length,
            &lt;span style=&#34;color: #4b69c6&#34;&gt;ascii_filename&lt;/span&gt; if opts.asciiize else sanitize_file_name,
            to_lowercase&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;opts.to_lowercase,&lt;/span&gt;
            replace_whitespace&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;opts.replace_whitespace,&lt;/span&gt; safe_format&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;False,&lt;/span&gt;
            last_has_extension&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;False,&lt;/span&gt; single_dir&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;opts.single_dir&lt;/span&gt;)
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/library/save_to_disk.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 251, in get_components
        &lt;span style=&#34;color: #4b69c6&#34;&gt;components&lt;/span&gt; = Formatter()&lt;span style=&#34;color: #4b69c6&#34;&gt;.unsafe_format&lt;/span&gt;(template, format_args, mi)
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/utils/formatter.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 1978, in unsafe_format
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; self.evaluate(fmt, &lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt;, kwargs, self.global_vars)
               &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/utils/formatter.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 1891, in evaluate
        &lt;span style=&#34;color: #4b69c6&#34;&gt;ans&lt;/span&gt; = self._eval_python_template(fmt&lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;7:&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt;, self.column_name)
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/utils/formatter.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 1758, in _eval_python_template
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; self._run_python_template(func, arguments=None)
               &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;^^^^^^^^^^^^^^^^^^^^^^&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/utils/formatter.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 1784, in _run_python_template
        &lt;span style=&#34;color: #4b69c6&#34;&gt;raise&lt;/span&gt; ValueError(_(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Error in function {0} on line {1} : {2} - {3}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;.format&lt;/span&gt;(
                        &lt;span style=&#34;color: #4b69c6&#34;&gt;ss.name,&lt;/span&gt; ss.lineno, type(e)&lt;span style=&#34;color: #4b69c6&#34;&gt;.__name__,&lt;/span&gt; str(e)))
    &lt;span style=&#34;color: #4b69c6&#34;&gt;ValueError:&lt;/span&gt; Error in function evaluate on line 94 : NameError - name &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; is not defined

    &lt;span style=&#34;color: #4b69c6&#34;&gt;During&lt;/span&gt; handling of the above exception, another exception occurred:

    &lt;span style=&#34;color: #4b69c6&#34;&gt;Traceback&lt;/span&gt; (most recent call last)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/gui2/save.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 138, in do_one_collect
        &lt;span style=&#34;color: #4b69c6&#34;&gt;self.collect_data&lt;/span&gt;(book_id)
        &lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;~&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;^^^^^^^^^&lt;/span&gt;
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/gui2/save.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 146, in collect_data
        &lt;span style=&#34;color: #4b69c6&#34;&gt;components&lt;/span&gt; = get_path_components(self.opts, mi, book_id, self.path_length)
      &lt;span style=&#34;color: #4b69c6&#34;&gt;File&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/usr/lib/calibre/calibre/library/save_to_disk.py&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, line 292, in get_path_components
        &lt;span style=&#34;color: #4b69c6&#34;&gt;raise&lt;/span&gt; ValueError(_(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Failed to calculate path for &lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;
            &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;save to disk. Template: %(templ)s\n&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;
            &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Error: %(err)s&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;%&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;dict&lt;/span&gt;(templ=opts.template, err=e))
    &lt;span style=&#34;color: #4b69c6&#34;&gt;ValueError:&lt;/span&gt; Failed to calculate path for save to disk. Template: python:
    &lt;span style=&#34;color: #4b69c6&#34;&gt;def&lt;/span&gt; evaluate(book, context)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;import&lt;/span&gt; re
        &lt;span style=&#34;color: #4b69c6&#34;&gt;import&lt;/span&gt; ast

        &lt;span style=&#34;color: #4b69c6&#34;&gt;def&lt;/span&gt; clean(s)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;not&lt;/span&gt; s:
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = str(s)
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Replace &amp;amp; with &amp;#34;and&amp;#34;, remove dots, brackets, quotes, colons, commas&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;and&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\.&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\[\]\(\)\{\}]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[\&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;:,]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = s.strip()
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Whitespace -&amp;gt; hyphen&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Collapse repeated separators&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Trim edges&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; s.strip(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)

        &lt;span style=&#34;color: #4b69c6&#34;&gt;def&lt;/span&gt; first_author_name(book)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Prefer author_sort: &amp;#34;Last, First &amp;amp; Last2, First2&amp;#34;&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;a_sort&lt;/span&gt; = book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;author_sort&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #4b69c6&#34;&gt;or&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;a_sort:&lt;/span&gt;
                &lt;span style=&#34;color: #4b69c6&#34;&gt;first&lt;/span&gt; = re.split(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s*&amp;amp;\s*|\s*;\s*|\s+and\s+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, a_sort)&lt;span style=&#34;color: #4b69c6&#34;&gt;[0].strip&lt;/span&gt;()
                if &amp;#34;,&amp;#34; in first:
                    last, firsts = [p.strip() for p in first.split(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;,&lt;/span&gt; 1)&lt;span style=&#34;color: #4b69c6&#34;&gt;]&lt;/span&gt;
                    &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;{firsts} {last}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;.strip()
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; first

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Fallback: authors (may be list or a stringified list)&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;authors&lt;/span&gt; = book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt;)
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;isinstance&lt;/span&gt;(authors, (list, tuple))&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; authors&lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;0&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt; if authors else &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;isinstance&lt;/span&gt;(authors, str)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
                &lt;span style=&#34;color: #4b69c6&#34;&gt;s&lt;/span&gt; = authors.strip()
                &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;s.startswith&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;[&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #4b69c6&#34;&gt;and&lt;/span&gt; s.endswith(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;]&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
                    &lt;span style=&#34;color: #4b69c6&#34;&gt;try:&lt;/span&gt;
                        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Attempt to parse it as a Python literal&lt;/span&gt;
                        &lt;span style=&#34;color: #4b69c6&#34;&gt;parsed&lt;/span&gt; = ast.literal_eval(s)
                        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;isinstance&lt;/span&gt;(parsed, (list, tuple)) &lt;span style=&#34;color: #4b69c6&#34;&gt;and&lt;/span&gt; parsed:
                            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; str(parsed&lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;0&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt;)
                    &lt;span style=&#34;color: #4b69c6&#34;&gt;except&lt;/span&gt; (ValueError, SyntaxError)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
                        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; If ast fails, fall back to string manipulation.&lt;/span&gt;
                        &lt;span style=&#34;color: #4b69c6&#34;&gt;s_no_brackets&lt;/span&gt; = s&lt;span style=&#34;color: #d73948&#34;&gt;[&lt;/span&gt;1:&lt;span style=&#34;color: #d73948&#34;&gt;-&lt;/span&gt;1&lt;span style=&#34;color: #d73948&#34;&gt;]&lt;/span&gt;.strip()
                        &lt;span style=&#34;color: #4b69c6&#34;&gt;first_author_str&lt;/span&gt; = s_no_brackets.split(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;[0].strip&lt;/span&gt;()
                        return first_author_str.strip(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)

                &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; If it&amp;#39;s a regular string with multiple authors, split by common delimiters&lt;/span&gt;
                &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; in s or &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; in s or &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; in s:
                    &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; re.split(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;\s*&amp;amp;\s*|\s*,\s*|\s*;\s*&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, s)&lt;span style=&#34;color: #4b69c6&#34;&gt;[0].strip&lt;/span&gt;()

                return s  &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; It&amp;#39;s a single author name as a string&lt;/span&gt;

            return &amp;#34;&amp;#34;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- AUTHOR ----&lt;/span&gt;
        author_name = first_author_name(&lt;span style=&#34;color: #4b69c6&#34;&gt;book&lt;/span&gt;) &lt;span style=&#34;color: #4b69c6&#34;&gt;or&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Unknown&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;author&lt;/span&gt; = clean(author_name)

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- TITLE ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;title&lt;/span&gt; = clean(book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;title&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;))

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- PUBLISHER ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher&lt;/span&gt; = clean(book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;publisher&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;))

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- YEAR ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;pubdate&lt;/span&gt; = book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;pubdate&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, None)
        &lt;span style=&#34;color: #4b69c6&#34;&gt;year&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;pubdate&lt;/span&gt; and hasattr(pubdate, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;strftime&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;y&lt;/span&gt; = pubdate.strftime(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;%Y&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;y.isdigit&lt;/span&gt;() and int(&lt;span style=&#34;color: #4b69c6&#34;&gt;y&lt;/span&gt;) &lt;span style=&#34;color: #198810&#34;&gt;&amp;gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;1000:&lt;/span&gt;
                &lt;span style=&#34;color: #4b69c6&#34;&gt;year&lt;/span&gt; = y

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- SERIES ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;series&lt;/span&gt; = book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;series:&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;series_index&lt;/span&gt; = book.get(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;series_index&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, 0)
            &lt;span style=&#34;color: #4b69c6&#34;&gt;series_part&lt;/span&gt; = f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-{clean(series)}-{int(series_index):0d}_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;else&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;:&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;series_part&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- PUBLISHER PART ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;publisher_part&lt;/span&gt; = f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_{publisher}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; if publisher else &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- TITLE+YEAR ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;titleyear&lt;/span&gt; = f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_{year}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; if year else &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; ---- BUILD PATH ----&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;path&lt;/span&gt; = f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;{authors}/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;year:&lt;/span&gt;
            &lt;span style=&#34;color: #4b69c6&#34;&gt;path&lt;/span&gt; += f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;{year}/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;path&lt;/span&gt; += f&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;{series_part}{title}{titleyear}{publisher_part}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Final safety pass&lt;/span&gt;
        &lt;span style=&#34;color: #4b69c6&#34;&gt;path&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, path)
        &lt;span style=&#34;color: #4b69c6&#34;&gt;path&lt;/span&gt; = re.sub(r&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_+&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, path)
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; path.strip(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;-_&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
    &lt;span style=&#34;color: #4b69c6&#34;&gt;Error:&lt;/span&gt; Error in function evaluate on line 94 : NameError - name &lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;authors&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt; is not defined&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/details&gt;&lt;p&gt;And lastly, here’s a sample of my ebooks nicely organised.&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;sh&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;sh&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;sh&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;library/documents/books&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Alexandre-Dumas
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2004
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Count-of-Monte-Cristo-Abridged_2004_Barnes-and-Noble.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Arundhati-Roy
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2020
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Azadi-Freedom-Fascism-Fiction_2020_Haymarket-Books.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Avvaiyar
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2009
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Give-Eat-and-Live-Poems-of-Avvaiyar_2009_Red-Hen-Press.pdf
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Ellen-Lupton
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   ├── 2010
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   │   └── Thinking-with-Type-A-Critical-Guide-for-Designers-Writers-Editors-and-Students-2nd-Edition_2010.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; George-Saunders
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2021
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── A-Swim-in-a-Pond-in-the-Rain_2021_Random-House-Publishing-Group.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Julia-Cameron
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2016
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── The-Artists-Way-25th-Anniversary-Edition_2016_Penguin-Publishing-Group.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Kyle-Siemens
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2022
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Piranha-Fishing-in-the-Amazon_2022.pdf
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Lao-tzu
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 1996
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Taoteching-With-Selected-Commentaries-from-the-Past-2000-Years_1996_Red-Pine.pdf
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Martha-Beck
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2021
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── The-Way-of-Integrity-Finding-the-Path-to-Your-True-Self_2021_Penguin-Publishing-Group.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Raynor-Winn
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2018
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── The-Salt-Path_2018_Penguin-Books-Limited.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Sir-Ernest-Henry-Shackleton
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2012
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── South-The-Story-of-Shackletons-Last-Expedition-1914-1917_2012_Duke-Classics.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Susan-Sontag
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2021
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── On-Photography_2021.pdf
&lt;span style=&#34;color: #4b69c6&#34;&gt;├──&lt;/span&gt; Ta-Nehisi-Coates
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;   └── 2015
&lt;span style=&#34;color: #4b69c6&#34;&gt;│&lt;/span&gt;       └── Between-the-World-and-Me_2015_Random-House-Publishing-Group.epub
&lt;span style=&#34;color: #4b69c6&#34;&gt;└──&lt;/span&gt; Viktor-E-Frankl
    &lt;span style=&#34;color: #4b69c6&#34;&gt;└──&lt;/span&gt; 2006
        &lt;span style=&#34;color: #4b69c6&#34;&gt;└──&lt;/span&gt; Mans-Search-for-Meaning_2006_Beacon-Press.epub&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;I also dug out my PDF fix-up tricks on a couple PDFs. The first was just missing an EOF in the file, so:&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;sh&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;sh&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;sh&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;pdftk&lt;/span&gt; \
    Cappadocia-A-Travel-Guide-Through-the-Land-of-Fairychimneys-and-Rock-Castles_2010_Books-on-Demand.pdf \
    output \
    Cappadocia-A-Travel-Guide-Through-the-Land-of-Fairychimneys-and-Rock-Castles_2010_Books-on-Demand-Repaired.pdf&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;The second had major Xref issues throughout and even using &lt;code&gt;ghostscript&lt;/code&gt; to try and fully rewrite it proved insufficient :(&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;sh&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;sh&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;sh&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;ghostscript&lt;/span&gt; \
    -o Cool-Tools-A-Catalog-of-Possibilities_2014-Repaired.pdf \
    -sDEVICE&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;pdfwrite -dPDFSETTINGS&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;/prepress \
    Cool-Tools-A-Catalog-of-Possibilities_2014.pdf&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;I’ll have to revisit that one another time. File still works fine, PDF readers are tolerant, but it being malformed means I can’t fix-up all the metadata I’ve added.&lt;/p&gt;6:45pm on August 19, 2025 from Tbilisi, Georgia&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CWrestling%20Calibre%20to%20organise%20books%20my%20way%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>A sensible folder hierarchy for MusicBrainz Picard</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/picard-folders" />
  <id>tag:silasjelley.com,2020-08-20:5ed5ef9b-15e8-4d04-a5d4-a698c70c6030</id>
  <published>2025-07-01T13:09:06+04:00</published>
  <updated>2025-07-01T13:09:06+04:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>After circling back to tweak my file naming script for MusicBrainz Picard, I finally have a pattern I’m happy with, so I’m preserving it here so this fiddling need not be repeated.</summary>
<mosaic:place>Batumi, Adjara, Georgia</mosaic:place>
<content type="html">
    &lt;p&gt;After circling back to tweak my file naming script for MusicBrainz Picard, I finally have a pattern I’m happy with, so I’m preserving it here so this fiddling need not be repeated.&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;js&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;js&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;js&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;$if2&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;albumartist&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artist&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;)&lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;album&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;$if&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;originalyear&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,\(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;originalyear&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;\))&lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;$num&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;tracknumber&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,&lt;span style=&#34;color: #b60157&#34;&gt;2&lt;/span&gt;) &lt;span style=&#34;color: #4b69c6&#34;&gt;$strip&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;title&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;$if&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;$gt&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;$lenmulti&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artists&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;),&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;), \(feat. &lt;span style=&#34;color: #4b69c6&#34;&gt;$if&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;$gt&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;$lenmulti&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artists&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;),&lt;span style=&#34;color: #b60157&#34;&gt;2&lt;/span&gt;),&lt;span style=&#34;color: #4b69c6&#34;&gt;$join&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;$slice&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artists&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;,&lt;span style=&#34;color: #d73948&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;),&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;, &lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;)\, &lt;span style=&#34;color: #4b69c6&#34;&gt;$slice&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artists&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,&lt;span style=&#34;color: #d73948&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;,),&lt;span style=&#34;color: #4b69c6&#34;&gt;$slice&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;artists&lt;span style=&#34;color: #d73948&#34;&gt;%&lt;/span&gt;,&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;,))\)))&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;1:09pm on July 1, 2025 from Batumi, Adjara, Georgia&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CA%20sensible%20folder%20hierarchy%20for%20MusicBrainz%20Picard%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>January 31, 2025 12.31PM</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/2025/01/31/123153" />
  <id>tag:silasjelley.com,2020-08-20:cbff87cc-4b81-443b-8c7a-7d3947a39c4f</id>
  <published>2025-01-31T12:31:53-08:00</published>
  <updated>2025-01-31T12:31:53-08:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>Sum of data stored in AWS S3 Deep Archive as at 2025-01-31. Bear in mind that I haven’t done a full backup to cold storage for over a month, so this doesn’t include data from Dec/Jan.</summary>
<mosaic:place>Mt Pleasant, Vancouver, British Columbia, Canada</mosaic:place>
<content type="html">
    &lt;p&gt;Sum of data stored in AWS S3 Deep Archive as at 2025-01-31. Bear in mind that I haven’t done a full backup to cold storage for over a month, so this doesn’t include data from  Dec/Jan.&lt;/p&gt;&lt;div class=&#34;code-block&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code&gt;locus
    downloads:  443.4 GB
    functions:   65.4 MB
    images:     684.7 GB
    journal:     94.1 MB
    ledger:      36.7 MB
    library:    122.6 GB
    mail:         1.7 GB
    misc:       825.0 MB
    notes:        1.6 GB
    raws:       987.0 GB
    records:    144.5 GB
    scanning:   448.9 GB
    vault:      103.4 MB
    videos:    1100.0 GB

Total Storage: 3936   GB (approximate)&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;12:31pm on January 31, 2025 from Mt Pleasant, Vancouver, British Columbia, Canada&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CJanuary%2031%2C%202025%2012.31PM%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>Backups — bad strategies</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/backups-bad-strategies" />
  <id>tag:silasjelley.com,2020-08-20:cd217b60-cf87-4c2e-b57f-48963c78c357</id>
  <published>2024-12-12T23:35:32-08:00</published>
  <updated>2026-04-01T17:30:52+05:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>One thing’s for sure: until you have a backup strategy of some kind, you’re screwed, you just don’t know it yet. — Jeff Atwood, “What&#39;s Your Backup Strategy?”, Coding Horror, 2008 So it turns out…</summary>
<mosaic:place>Kitsilano, Vancouver, British Columbia, Canada</mosaic:place>
<content type="html">
    &lt;blockquote&gt;&lt;p&gt;One thing’s for sure: until you have a backup strategy of some kind, you’re screwed, you just don’t know it yet.&lt;/p&gt;&lt;cite&gt;— &lt;a href=&#34;/2024/12/12/203924&#34;&gt;Jeff Atwood, “What&amp;#39;s Your Backup Strategy?”, &lt;em&gt;Coding Horror&lt;/em&gt;, 2008&lt;/a&gt;&lt;/cite&gt;&lt;/blockquote&gt;&lt;p&gt;So it turns out computers weren’t just a phase, they’re here to stay, and more and more of the sum of our lives is made, transmitted, or remembered as 1′s and 0′s in these rocks we’ve tricked into thinking for us.&lt;/p&gt;&lt;p&gt;&lt;em&gt;So what happens when the music stops?&lt;/em&gt;&lt;/p&gt;&lt;p&gt;If you don’t have anything digital you care about, good for you, go and touch grass, skip this one. If you do have things you care about and you don’t have a &lt;em&gt;robust&lt;/em&gt; backup strategy then you’re heading for a bad day. Your computer will die. Your phone will die. You’ll lose access to your email account. And it will all happen at the worst possible time. Or it won’t, but is it worth the risk?&lt;/p&gt;&lt;p&gt;Good backups allow you to recover from all reasonable risks. They are simple, routine, robust to seen and unseen loss, and tested and familiar in the event that they’re needed. If you’re backup strategy fails &lt;em&gt;any&lt;/em&gt; of these tests then it is a problem waiting to happen. If it isn’t simple it will fail when you need it most. If it isn’t routine you won’t do it. If it isn’t off-site it’s not a backup. If it isn’t tested it isn’t real.&lt;/p&gt;&lt;aside class=&#34;aside&#34;&gt;&lt;p&gt;&lt;em&gt;Examples of bad backup strategies&lt;/em&gt;&lt;/p&gt;&lt;p&gt;Having a single backup on an external drive that sits right next to your computer — or anywhere in the same house. It seems safe, until both are stolen in a break-in or destroyed in the same fire or flood.&lt;/p&gt;&lt;p&gt;Everything synced to Dropbox/iCloud/Google Drive or similar. If this is you, give yourself a brief pat on that back because you’re doing better than most, but then stop that and listen. This is not a good backup — synchronisation is not the same as backup. Two-way synchronisation is a surprising and insidious point-of-failure wherein damage (corrupted files, ransomware, accidental deletions) will silently propagate between synchronised devices, removing opportunities for recovery. By all means synchronise your files between devices, but don’t mistake this mechanism of convenience for a backup.&lt;/p&gt;&lt;p&gt;Having a routine system of backup that gives you peace of mind, only to discover that the backups had stopped running months ago, or some new folders weren’t being included. Untested backups are just wishful thinking.&lt;/p&gt;&lt;p&gt;Your backups are up to date and secured in multiple physical locations but you can’t access them because you’ve lost/forgotten the long pseudo-random password you encrypted them with — perhaps it was stored on your computer and your phone and you never anticipated losing both in the same incident. Having a complete backup on a hard-drive in your hand is useless if it’s encrypted with a key you don’t have.&lt;/p&gt;&lt;p&gt;You have backups, but no version history, and now you really wish you had the previous version of that draft of chapter 2 of your secret memoir, because you’re convinced you really preferred that version, but it’s gone and now you’ll never be the best selling author your year 6 English teacher always said you would be.&lt;/p&gt;&lt;/aside&gt;&lt;p&gt;From those examples we arrive at a working list of scenarios we might want to guard against, which I’ll group according the kind of vulnerability they represent, and how each is best solved for.&lt;/p&gt;&lt;aside class=&#34;aside&#34;&gt;&lt;p&gt;&lt;strong&gt;Digital error&lt;/strong&gt;&lt;br/&gt;&lt;em&gt;corruption, accidental deletion, ransomware&lt;/em&gt;&lt;/p&gt;&lt;p&gt;The &lt;a href=&#34;https://en.wikipedia.org/wiki/Soft_error#Cosmic_rays_creating_energetic_neutrons_and_protons&#34;&gt;sun got excited and threw out some cosmic rays&lt;/a&gt;, or you had a power outage while saving, or your filesystem corrupted itself and now a file is returning bad data, or some guy in a basement somewhere has gotten root access to your machine and encrypted all your files and in order to get the key you’ll have to pay him $10,000 in Butt-coin.&lt;/p&gt;&lt;p&gt;&lt;span style=&#34;font-variant-caps: small-caps&#34;&gt;Solution&lt;/span&gt; — Immutable, versioned backups&lt;/p&gt;&lt;/aside&gt;&lt;aside class=&#34;aside&#34;&gt;&lt;p&gt;&lt;strong&gt;Physical loss&lt;/strong&gt;&lt;br/&gt;&lt;em&gt;theft, natural disaster, equipment failure&lt;/em&gt;&lt;/p&gt;&lt;p&gt;It’s gone and you know it. Your house burns down with your computer inside, your hard-drive fails completely, your phone stops turning on.&lt;/p&gt;&lt;p&gt;&lt;span style=&#34;font-variant-caps: small-caps&#34;&gt;Solution&lt;/span&gt; — Multiple backups on different devices/media, stored in physically different locations.&lt;/p&gt;&lt;/aside&gt;&lt;aside class=&#34;aside&#34;&gt;&lt;p&gt;&lt;strong&gt;Human error&lt;/strong&gt;&lt;br/&gt;&lt;em&gt;incomplete backups, silent failure, encryption lockout&lt;/em&gt;&lt;/p&gt;&lt;p&gt;It’s gone and you don’t (yet) know it. You won’t find out until your primary fails and it’s too late, all is &lt;em&gt;&lt;a href=&#34;/2024/01/21/120011&#34; title=&#34;Annie Dillard, The Writing Life, 1989&#34; data-preview=&#34;/previews/2bffc7de-5785-459e-974b-28bbe528f111.html&#34;&gt;lost to you. You open your safe and find ashes&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;&lt;p&gt;&lt;span style=&#34;font-variant-caps: small-caps&#34;&gt;Solution&lt;/span&gt; — Thoroughly test your backups!&lt;/p&gt;&lt;/aside&gt;&lt;p&gt;Taken together, good backups are immutable, versioned, stored in multiple locations, with a known and tested recovery story that covers the loss of all your devices at once, no matter how unlikely that seems to you.&lt;/p&gt;&lt;blockquote&gt;&lt;p&gt;The universe tends toward maximum irony. Don’t push it.&lt;/p&gt;&lt;cite&gt;— &lt;a href=&#34;/2024/12/12/212338&#34;&gt;Jamie Zawinski, &lt;em&gt;PSA: backups&lt;/em&gt;, 2007&lt;/a&gt;&lt;/cite&gt;&lt;/blockquote&gt;&lt;p&gt;In the next part of this series, I detail a specific worst case scenario which we will use to test our final backup strategy.&lt;/p&gt;11:35pm on December 12, 2024 from Kitsilano, Vancouver, British Columbia, Canada&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CBackups%20%E2%80%94%20bad%20strategies%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>Scraping your posts from BlueSky with Python</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/scraping-bluesky" />
  <id>tag:silasjelley.com,2020-08-20:396d7c9e-9bdc-41da-93f3-6971c33b5301</id>
  <published>2024-12-10T10:11:27-08:00</published>
  <updated>2024-12-10T10:11:27-08:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>Inspired by my writing in public everyday for a month, which often draws from things I’ve read or watched, Kyle wants to get into the habit of writing a little something about the things he…</summary>
<mosaic:place>Kitsilano, Vancouver, British Columbia, Canada</mosaic:place>
<content type="html">
    &lt;p&gt;Inspired by my writing in public everyday for a month, which often draws from things I’ve read or watched, Kyle wants to get into the habit of writing a little something about the things he reads/watches/etc.&lt;/p&gt;&lt;p&gt;&lt;a href=&#34;https://bsky.app/profile/silasjelley.com/post/3lcz5yazohs2x&#34;&gt;BlueSky&lt;/a&gt; came up as an option for a character limited, low-barrier, write-once platform, and while I’m broadly averse to centralised platforms&lt;sup class=&#34;fn-ref&#34;&gt;&lt;a href=&#34;#fn1&#34; id=&#34;fnref1&#34; role=&#34;doc-noteref&#34;&gt;1&lt;/a&gt;&lt;/sup&gt; I recognise the appeal of simple UX and broad reach.&lt;/p&gt;&lt;p&gt;&lt;a href=&#34;https://indieweb.org/POSSE&#34;&gt;POSSE (Publish (on your) Own Site, Syndicate Elsewhere)&lt;/a&gt; is one avenue for satisfying the tension between sovereignty and syndication, but if the goal is low-friction then perhaps the reverse — publishing elsewhere and then preserving on your own site — is a less complicated flow.&lt;/p&gt;&lt;p&gt;I toyed around with a simple Python program for pulling posts into my own document system, using Anthropic’s Claude 3.5 Sonnet to knock together the rough shape of the scraper, and then tweaking and expanding it to my liking.&lt;/p&gt;&lt;p&gt;The code is included at the end, but it may not be useful to you &lt;em&gt;as is&lt;/em&gt;. So, in no particular order, and with no promises of completeness, here are some of the assumptions I’ve made,&lt;/p&gt;&lt;ul&gt;&lt;li&gt;&lt;p&gt;Each post is only downloaded once. A sidecar JSON file is read and re-written on each run to keep track of the &lt;code&gt;at://&lt;/code&gt; identifier of each saved post so the script can be re-run and only new posts will be downloaded.&lt;/p&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;Message content is stored as a TOML &lt;a href=&#34;https://toml.io/en/v1.0.0#string&#34;&gt;multi-line literal string&lt;/a&gt; so can contain anything &lt;em&gt;except&lt;/em&gt; three consecutive single quotes.&lt;/p&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;While I’ve begun work on preserving media, currently this is not implemented. See the &lt;code&gt;download_media&lt;/code&gt; function for the work so far.&lt;/p&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;Uses the &lt;a href=&#34;https://docs.bsky.app/docs/api/app-bsky-feed-get-author-feed&#34;&gt;getAuthorFeed&lt;/a&gt; API endpoint which includes the given author’s reposts and comments, and currently naively polls for all of an authors posts rather than specifying ‘posts since X date’ or similar.&lt;/p&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;The &lt;code&gt;created_at&lt;/code&gt; datetime is converted to a localised datetime, if you’d prefer UTC, replace all instances of &lt;code&gt;local_dt&lt;/code&gt; in the code with &lt;code&gt;utc_dt&lt;/code&gt;.&lt;/p&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;Metadata is added to each entry according to the needs of my document system, you can remove or change these in the &lt;code&gt;doc&lt;/code&gt; metadata block shown here in &lt;code&gt;create_toml_doc()&lt;/code&gt;,&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;python&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;python&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;python&#34;&gt;&lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Basic metadata&lt;/span&gt;
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;uid&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;(uuid.&lt;span style=&#34;color: #4b69c6&#34;&gt;uuid4&lt;/span&gt;())
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;creator&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; creator_name
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;primary&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;journal&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;secondary&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;nonsense&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;created&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; local_dt
doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;slug&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;create_slug&lt;/span&gt;(local_dt)&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;Each post is saved as a separate TOML document with the following structure,&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;toml&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;toml&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;toml&#34;&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;uid&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;3f335802-34e4-4b9b-8a29-a26afe348344&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;creator&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Silas Jelley&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;primary&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;journal&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;secondary&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;nonsense&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;created&lt;/span&gt; = &lt;span style=&#34;color: #b60157&#34;&gt;2024-11-21T18:12:40.260000-08:00&lt;/span&gt;
&lt;span style=&#34;color: #4b69c6&#34;&gt;slug&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;2024/11/21/181240&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
[&lt;span style=&#34;color: #4b69c6&#34;&gt;content&lt;/span&gt;]
&lt;span style=&#34;color: #4b69c6&#34;&gt;plain&lt;/span&gt; = &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #198810&#34;&gt;Any fool can repeat the right answer, but who’s asking the right questions?&lt;/span&gt;
&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;&lt;li&gt;&lt;p&gt;The script takes 2 required positional arguments, and 3 optional arguments&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;text&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;text&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;text&#34;&gt;usage: import-bluesky [-h] [--creator CREATOR] [--limit LIMIT] [--output-dir OUTPUT_DIR] identifier password

Scrape BlueSky posts and save as TOML files

positional arguments:
  identifier            Your BlueSky handle or email
  password              Your BlueSky password

options:
  -h, --help            show this help message and exit
  --creator CREATOR     Creator name for TOML files (defaults to identifier)
  --limit LIMIT         Maximum number of posts to retrieve (default: 500)
  --output-dir OUTPUT_DIR
                        Directory to store TOML files (default: posts)&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;Still todo:&lt;/p&gt;&lt;ul&gt;&lt;li&gt;Save post url with document in a &lt;code&gt;[source]&lt;/code&gt; block&lt;/li&gt;&lt;li&gt;Save media included in the post&lt;/li&gt;&lt;li&gt;(possibly) Save likes, replies etc&lt;/li&gt;&lt;/ul&gt;&lt;p&gt;The complete script,&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;python&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;python&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;python&#34;&gt;&lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;!/usr/bin/env python3&lt;/span&gt;

&lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; requests
&lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; json
&lt;span style=&#34;color: #d73948&#34;&gt;from&lt;/span&gt; datetime &lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; datetime
&lt;span style=&#34;color: #d73948&#34;&gt;from&lt;/span&gt; typing &lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; List, Dict, Optional, Tuple
&lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; tomlkit
&lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; uuid
&lt;span style=&#34;color: #d73948&#34;&gt;from&lt;/span&gt; pathlib &lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; Path
&lt;span style=&#34;color: #d73948&#34;&gt;import&lt;/span&gt; argparse

&lt;span style=&#34;color: #d73948&#34;&gt;class&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;BlueSkyPostScraper&lt;/span&gt;:
    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;__init__&lt;/span&gt;(self, identifier: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, password: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, output_dir: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;posts&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;):
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #74747c&#34;&gt;        Initialize the BlueSky scraper with your credentials.&lt;/span&gt;
&lt;span style=&#34;color: #74747c&#34;&gt;        &lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.base_url &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;https://bsky.social/xrpc&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.session &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; requests.&lt;span style=&#34;color: #4b69c6&#34;&gt;Session&lt;/span&gt;()
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.auth_token &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.did &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.output_dir &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;Path&lt;/span&gt;(output_dir)
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.media_dir &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.output_dir &lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;media&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.output_dir.&lt;span style=&#34;color: #4b69c6&#34;&gt;mkdir&lt;/span&gt;(parents&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;True&lt;/span&gt;, exist_ok&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;True&lt;/span&gt;)
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.media_dir.&lt;span style=&#34;color: #4b69c6&#34;&gt;mkdir&lt;/span&gt;(parents&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;True&lt;/span&gt;, exist_ok&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;True&lt;/span&gt;)
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.tracking_file &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.output_dir &lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;downloaded_posts.json&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.downloaded_posts &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;_load_tracking&lt;/span&gt;()
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;_login&lt;/span&gt;(identifier, password)
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.username &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; identifier

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;download_media&lt;/span&gt;(self, image_info: Dict) -&amp;gt; Optional[Tuple[&lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;]]:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
&lt;span style=&#34;color: #74747c&#34;&gt;        Download media from BlueSky and return the local path.&lt;/span&gt;
&lt;span style=&#34;color: #74747c&#34;&gt;        Returns (filename, mime_type) tuple if successful, None if failed.&lt;/span&gt;
&lt;span style=&#34;color: #74747c&#34;&gt;        &lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;try&lt;/span&gt;:
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Extract image URL and type&lt;/span&gt;
            blob &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; image_info.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;blob&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, {})
            ref &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; blob.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;ref&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, {})
            link &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;https://bsky.social/xrpc/com.atproto.sync.getBlob?did=&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;did&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;amp;cid=&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;ref&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$link&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;,&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt; &lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
            mime_type &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; blob.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;mimeType&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)

            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;not&lt;/span&gt; mime_type.&lt;span style=&#34;color: #4b69c6&#34;&gt;startswith&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;image/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;):
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Download the image&lt;/span&gt;
            response &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.session.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(link)
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; response.status_code &lt;span style=&#34;color: #d73948&#34;&gt;!=&lt;/span&gt; &lt;span style=&#34;color: #b60157&#34;&gt;200&lt;/span&gt;:
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Create filename based on content hash&lt;/span&gt;
            content_hash &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; hashlib.&lt;span style=&#34;color: #4b69c6&#34;&gt;sha256&lt;/span&gt;(response.content).&lt;span style=&#34;color: #4b69c6&#34;&gt;hexdigest&lt;/span&gt;()[:&lt;span style=&#34;color: #b60157&#34;&gt;16&lt;/span&gt;]
            ext &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; mime_type.&lt;span style=&#34;color: #4b69c6&#34;&gt;split&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)[&lt;span style=&#34;color: #d73948&#34;&gt;-&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;1&lt;/span&gt;]
            filename &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;content_hash&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;ext&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
            filepath &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.media_dir &lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt; filename

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Save the image&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;with&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;open&lt;/span&gt;(filepath, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;wb&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; f:
                f.&lt;span style=&#34;color: #4b69c6&#34;&gt;write&lt;/span&gt;(response.content)

            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; filename, mime_type
        &lt;span style=&#34;color: #d73948&#34;&gt;except&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;Exception&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; e:
            &lt;span style=&#34;color: #4b69c6&#34;&gt;print&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Failed to download media: &lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;e&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
            &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;create_toml_doc&lt;/span&gt;(
        self, post: Dict, creator_name: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, media_files: List[Tuple[&lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;]] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;
    ) -&amp;gt; tomlkit.document:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Create a TOML document for a post.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        doc &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; tomlkit.&lt;span style=&#34;color: #4b69c6&#34;&gt;document&lt;/span&gt;()

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Convert UTC datetime string to local datetime object&lt;/span&gt;
        utc_dt &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; datetime.&lt;span style=&#34;color: #4b69c6&#34;&gt;fromisoformat&lt;/span&gt;(post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;created_at&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;replace&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Z&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;+00:00&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;))
        local_dt &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; utc_dt.&lt;span style=&#34;color: #4b69c6&#34;&gt;astimezone&lt;/span&gt;()

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Basic metadata&lt;/span&gt;
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;uid&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;(uuid.&lt;span style=&#34;color: #4b69c6&#34;&gt;uuid4&lt;/span&gt;())
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;creator&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; creator_name
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;primary&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;journal&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;secondary&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;nonsense&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;created&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; local_dt
        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;slug&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;create_slug&lt;/span&gt;(local_dt)

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Content section&lt;/span&gt;
        content &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; tomlkit.&lt;span style=&#34;color: #4b69c6&#34;&gt;table&lt;/span&gt;()
        content[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;plain&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\n&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt; post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;message&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;+&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #1d6c76&#34;&gt;\n&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Add media information if present&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; media_files:
            media &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; tomlkit.&lt;span style=&#34;color: #4b69c6&#34;&gt;array&lt;/span&gt;()
            &lt;span style=&#34;color: #d73948&#34;&gt;for&lt;/span&gt; filename, mime_type &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; media_files:
                media_item &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; tomlkit.&lt;span style=&#34;color: #4b69c6&#34;&gt;inline_table&lt;/span&gt;()
                media_item[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;filename&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; filename
                media_item[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;type&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; mime_type
                media.&lt;span style=&#34;color: #4b69c6&#34;&gt;append&lt;/span&gt;(media_item)
            content[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;media&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; media

        doc[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;content&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; content
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; doc

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;get_posts&lt;/span&gt;(self, limit: &lt;span style=&#34;color: #4b69c6&#34;&gt;int&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #b60157&#34;&gt;100&lt;/span&gt;) -&amp;gt; List[Dict]:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Fetch your posts from BlueSky.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        posts &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; []
        cursor &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;

        &lt;span style=&#34;color: #d73948&#34;&gt;while&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;len&lt;/span&gt;(posts) &lt;span style=&#34;color: #d73948&#34;&gt;&amp;lt;&lt;/span&gt; limit:
            params &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; {&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;actor&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.did, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;limit&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: &lt;span style=&#34;color: #4b69c6&#34;&gt;min&lt;/span&gt;(&lt;span style=&#34;color: #b60157&#34;&gt;100&lt;/span&gt;, limit &lt;span style=&#34;color: #d73948&#34;&gt;-&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;len&lt;/span&gt;(posts))}
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; cursor:
                params[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;cursor&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;] &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; cursor

            response &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.session.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(
                &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;base_url&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/app.bsky.feed.getAuthorFeed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, params&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;params
            )

            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; response.status_code &lt;span style=&#34;color: #d73948&#34;&gt;!=&lt;/span&gt; &lt;span style=&#34;color: #b60157&#34;&gt;200&lt;/span&gt;:
                &lt;span style=&#34;color: #d73948&#34;&gt;break&lt;/span&gt;

            data &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; response.&lt;span style=&#34;color: #4b69c6&#34;&gt;json&lt;/span&gt;()
            feed_items &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; data.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;feed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, [])

            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;not&lt;/span&gt; feed_items:
                &lt;span style=&#34;color: #d73948&#34;&gt;break&lt;/span&gt;

            &lt;span style=&#34;color: #d73948&#34;&gt;for&lt;/span&gt; item &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; feed_items:
                post &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; item[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;post&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;]
                post_id &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;uri&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;]

                &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Skip if we&amp;#39;ve already downloaded this post&lt;/span&gt;
                &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; post_id &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.downloaded_posts:
                    &lt;span style=&#34;color: #d73948&#34;&gt;continue&lt;/span&gt;

                &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Extract post data including embedded media&lt;/span&gt;
                post_data &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; {
                    &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;message&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;record&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;text&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;),
                    &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;created_at&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;record&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;createdAt&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;),
                    &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;embed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: post[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;record&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;embed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, {}),
                }
                posts.&lt;span style=&#34;color: #4b69c6&#34;&gt;append&lt;/span&gt;((post_id, post_data))

            cursor &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; data.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;cursor&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;not&lt;/span&gt; cursor:
                &lt;span style=&#34;color: #d73948&#34;&gt;break&lt;/span&gt;

        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; posts

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;save_posts_as_toml&lt;/span&gt;(self, posts: List[&lt;span style=&#34;color: #4b69c6&#34;&gt;tuple&lt;/span&gt;], creator_name: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;) -&amp;gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Save posts as individual TOML files.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;for&lt;/span&gt; post_id, post_data &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; posts:
            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Handle media if present&lt;/span&gt;
            media_files &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; []
            embed &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; post_data.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;embed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, {})

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Handle images&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; embed.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;$type&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;==&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;app.bsky.embed.images&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;:
                &lt;span style=&#34;color: #d73948&#34;&gt;for&lt;/span&gt; image &lt;span style=&#34;color: #d73948&#34;&gt;in&lt;/span&gt; embed.&lt;span style=&#34;color: #4b69c6&#34;&gt;get&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;images&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, []):
                    result &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;download_media&lt;/span&gt;(image)
                    &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; result:
                        media_files.&lt;span style=&#34;color: #4b69c6&#34;&gt;append&lt;/span&gt;(result)

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Create TOML document with media information&lt;/span&gt;
            doc &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;create_toml_doc&lt;/span&gt;(post_data, creator_name, media_files)

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Create filename based on created date&lt;/span&gt;
            created_dt &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; datetime.&lt;span style=&#34;color: #4b69c6&#34;&gt;fromisoformat&lt;/span&gt;(
                post_data[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;created_at&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;].&lt;span style=&#34;color: #4b69c6&#34;&gt;replace&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Z&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;+00:00&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
            )
            filename &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;created_dt&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;strftime&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%Y&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%m&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%d&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;_&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%H&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%M&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%S&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#39;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;.toml&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
            filepath &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.output_dir &lt;span style=&#34;color: #d73948&#34;&gt;/&lt;/span&gt; filename

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Save TOML file&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;with&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;open&lt;/span&gt;(filepath, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;w&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, encoding&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;utf-8&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; f:
                tomlkit.&lt;span style=&#34;color: #4b69c6&#34;&gt;dump&lt;/span&gt;(doc, f)

            &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Mark post as downloaded&lt;/span&gt;
            &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.downloaded_posts.&lt;span style=&#34;color: #4b69c6&#34;&gt;add&lt;/span&gt;(post_id)

        &lt;span style=&#34;color: #74747c&#34;&gt;#&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt; Save tracking file&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.&lt;span style=&#34;color: #4b69c6&#34;&gt;_save_tracking&lt;/span&gt;()

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;_load_tracking&lt;/span&gt;(self) -&amp;gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt;:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Load the set of previously downloaded post IDs.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.tracking_file.&lt;span style=&#34;color: #4b69c6&#34;&gt;exists&lt;/span&gt;():
            &lt;span style=&#34;color: #d73948&#34;&gt;with&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;open&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.tracking_file, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;r&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; f:
                &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt;(json.&lt;span style=&#34;color: #4b69c6&#34;&gt;load&lt;/span&gt;(f))
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;set&lt;/span&gt;()

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;_save_tracking&lt;/span&gt;(self) -&amp;gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Save the set of downloaded post IDs.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;with&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;open&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.tracking_file, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;w&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;) &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; f:
            json.&lt;span style=&#34;color: #4b69c6&#34;&gt;dump&lt;/span&gt;(&lt;span style=&#34;color: #4b69c6&#34;&gt;list&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.downloaded_posts), f)

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;_login&lt;/span&gt;(self, identifier: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;, password: &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;) -&amp;gt; &lt;span style=&#34;color: #d73948&#34;&gt;None&lt;/span&gt;:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Authenticate with BlueSky.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        auth_response &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.session.&lt;span style=&#34;color: #4b69c6&#34;&gt;post&lt;/span&gt;(
            &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;base_url&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/com.atproto.server.createSession&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
            json&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;{&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;identifier&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: identifier, &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;password&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: password},
        )
        &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; auth_response.status_code &lt;span style=&#34;color: #d73948&#34;&gt;!=&lt;/span&gt; &lt;span style=&#34;color: #b60157&#34;&gt;200&lt;/span&gt;:
            &lt;span style=&#34;color: #d73948&#34;&gt;raise&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;Exception&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Authentication failed&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)

        auth_data &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; auth_response.&lt;span style=&#34;color: #4b69c6&#34;&gt;json&lt;/span&gt;()
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.auth_token &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; auth_data[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;accessJwt&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;]
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.did &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; auth_data[&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;did&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;]
        &lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;.session.headers.&lt;span style=&#34;color: #4b69c6&#34;&gt;update&lt;/span&gt;({&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Authorization&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;: &lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Bearer &lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #d73948&#34;&gt;self&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;.&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;auth_token&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;})

    &lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;create_slug&lt;/span&gt;(self, dt: datetime) -&amp;gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;:
        &lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;Create a slug from a datetime object.&lt;/span&gt;&lt;span style=&#34;color: #74747c&#34;&gt;&amp;#34;&amp;#34;&amp;#34;&lt;/span&gt;
        &lt;span style=&#34;color: #d73948&#34;&gt;return&lt;/span&gt; dt.&lt;span style=&#34;color: #4b69c6&#34;&gt;strftime&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%Y&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%m&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%d&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;/&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%H&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%M&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;%S&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)


&lt;span style=&#34;color: #d73948&#34;&gt;def&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;main&lt;/span&gt;():
    parser &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; argparse.&lt;span style=&#34;color: #4b69c6&#34;&gt;ArgumentParser&lt;/span&gt;(
        description&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Scrape BlueSky posts and save as TOML files&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    )
    parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;add_argument&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;identifier&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, help&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Your BlueSky handle or email&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
    parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;add_argument&lt;/span&gt;(&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;password&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, help&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Your BlueSky password&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
    parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;add_argument&lt;/span&gt;(
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;--creator&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;, help&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Creator name for TOML files (defaults to identifier)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;
    )
    parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;add_argument&lt;/span&gt;(
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;--limit&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
        type&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;int&lt;/span&gt;,
        default&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #b60157&#34;&gt;500&lt;/span&gt;,
        help&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Maximum number of posts to retrieve (default: 500)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
    )
    parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;add_argument&lt;/span&gt;(
        &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;--output-dir&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
        default&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;posts&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
        help&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Directory to store TOML files (default: posts)&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;,
    )

    args &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; parser.&lt;span style=&#34;color: #4b69c6&#34;&gt;parse_args&lt;/span&gt;()
    creator_name &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; args.creator &lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; args.creator &lt;span style=&#34;color: #d73948&#34;&gt;else&lt;/span&gt; args.identifier

    &lt;span style=&#34;color: #d73948&#34;&gt;try&lt;/span&gt;:
        scraper &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;BlueSkyPostScraper&lt;/span&gt;(args.identifier, args.password, args.output_dir)
        posts &lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt; scraper.&lt;span style=&#34;color: #4b69c6&#34;&gt;get_posts&lt;/span&gt;(limit&lt;span style=&#34;color: #d73948&#34;&gt;=&lt;/span&gt;args.limit)
        scraper.&lt;span style=&#34;color: #4b69c6&#34;&gt;save_posts_as_toml&lt;/span&gt;(posts, creator_name)
        &lt;span style=&#34;color: #4b69c6&#34;&gt;print&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Successfully scraped &lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;len&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;posts&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt; new posts&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)
    &lt;span style=&#34;color: #d73948&#34;&gt;except&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;Exception&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;as&lt;/span&gt; e:
        &lt;span style=&#34;color: #4b69c6&#34;&gt;print&lt;/span&gt;(&lt;span style=&#34;color: #d73948&#34;&gt;f&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;Error: &lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;{&lt;/span&gt;&lt;span style=&#34;color: #4b69c6&#34;&gt;str&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;(&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;e&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;)&lt;/span&gt;&lt;span style=&#34;color: #8b41b1&#34;&gt;}&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;)


&lt;span style=&#34;color: #d73948&#34;&gt;if&lt;/span&gt; &lt;span style=&#34;color: #4b69c6&#34;&gt;__name__&lt;/span&gt; &lt;span style=&#34;color: #d73948&#34;&gt;==&lt;/span&gt; &lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;__main__&lt;/span&gt;&lt;span style=&#34;color: #198810&#34;&gt;&amp;#34;&lt;/span&gt;:
    &lt;span style=&#34;color: #4b69c6&#34;&gt;main&lt;/span&gt;()&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;section role=&#34;doc-endnotes&#34;&gt;&lt;ol&gt;&lt;li id=&#34;fn1&#34;&gt;And before someone pipes up with “BlueSky/AT-protocol is decentralised!”, no, it isn’t. The corporation behind it claims it is, but so far it only aspires to be. If you’re curious, &lt;a href=&#34;https://beige.party/\@possibledog/113367977656537478&#34;&gt;you can read more here.&lt;/a&gt;&lt;/li&gt;&lt;/ol&gt;&lt;/section&gt;10:11am on December 10, 2024 from Kitsilano, Vancouver, British Columbia, Canada&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CScraping%20your%20posts%20from%20BlueSky%20with%20Python%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>
<entry>
  <title>Testing for counterfeit flash drives</title>
  <link rel="alternate" type="text/html" href="https://silasjelley.com/counterfeit-flash-drives" />
  <id>tag:silasjelley.com,2020-08-20:7f05d984-a1e9-47cc-8d03-648c6fecc181</id>
  <published>2023-06-08T15:49:22+01:00</published>
  <updated>2023-06-08T15:49:22+01:00</updated>
  <category term="journal" />
  <category term="tinkering" />
  <summary>One of the many treats offered up by this post-truth world we find ourselves in is the rise (and rise, and rise, and…) of scams, counterfeits, and fraud in just about every sphere. But rather than…</summary>
<mosaic:place>Frenchay, Bristol, England, United Kingdom</mosaic:place>
<content type="html">
    &lt;p&gt;One of the many treats offered up by this post-truth world we find ourselves in is the rise (and rise, and rise, and…) of scams, counterfeits, and fraud in just about every sphere. But rather than waffling on too much about the ills of large society, I’ll just record here a sound way to check if that SD card you bought online actually has the capacity it claims.&lt;/p&gt;&lt;p&gt;We’ll be using &lt;code&gt;f3probe&lt;/code&gt;, a command provided by the ‘&lt;a href=&#34;https://fight-flash-fraud.readthedocs.io/en/latest/introduction.html&#34;&gt;f3&lt;/a&gt;’ package available in the Arch User Repository (AUR).&lt;/p&gt;&lt;p&gt;The below command does a full write and read back across the drive and reports back on whether it is true to it’s word or counterfeit.&lt;/p&gt;&lt;p&gt;WARNING: Any data on the drive will be erased!&lt;/p&gt;&lt;div class=&#34;code-block&#34; data-lang=&#34;shell&#34;&gt;&lt;div class=&#34;code-header&#34; data-mosaic-chrome=&#34;&#34;&gt;&lt;span class=&#34;code-lang&#34;&gt;shell&lt;/span&gt;&lt;button class=&#34;code-copy&#34; aria-label=&#34;Copy code&#34; type=&#34;button&#34;&gt;Copy&lt;/button&gt;&lt;/div&gt;&lt;pre&gt;&lt;code data-lang=&#34;shell&#34;&gt;f3probe --destructive --time-ops /dev/mmcblk0&lt;/code&gt;&lt;/pre&gt;&lt;/div&gt;&lt;p&gt;Replace &lt;code&gt;/dev/mmcblk0&lt;/code&gt; with a full path to the flash/thumb/SD drive in question and wait for it to complete.&lt;/p&gt;&lt;p&gt;Be aware that on large and/or slow drives this could take some time. For a good quality SD card in 64GB it should take only a few minutes but may take as much as 15.&lt;/p&gt;3:49pm on June 8, 2023 from Frenchay, Bristol, England, United Kingdom&lt;p&gt;&lt;a href=&#34;mailto:reply@silasjelley.com?subject=Reply%20to%3A%20%E2%80%9CTesting%20for%20counterfeit%20flash%20drives%E2%80%9D&#34;&gt;Reply via email&lt;/a&gt;&lt;/p&gt;
</content>
</entry>

<div xmlns="http://www.w3.org/1999/xhtml" id="feed-chrome" hidden="" data-stylesheet="/style.css?a959535639bceb541eb7a955189913b9">
<header class="site-header">
<nav class="site-nav" aria-label="Site">
<a class="homelink" href="/" title="Homepage of silasjelley.com">Silas Jelley</a>
<ul class="navmain">
<li><a href="/wandering" title="Tales of my worldly travels">Wandering</a></li>
<li><a href="/rambling" title="The ramblings of an itinerant fool">Rambling</a></li>
<li><a href="/nonsense" title="Shaking my brain stem and seeing what fruit falls">Nonsense</a></li>
<li><a href="/quotes" title="Quotes, saved from anything and anywhere I find interest">Quotes</a></li>
</ul>
<ul class="navmisc top">
<li><a href="/about" title="Learn a little more about the author.">About</a></li>
<li><a href="/contact" title="Get in touch with me!">Contact</a></li>
<li><a href="/search" title="Search silasjelley.com">Search</a></li>
<li class="theme-choice" hidden=""><select class="theme-select" aria-label="Theme" title="Colour theme"><option value="system">Auto</option><option value="sepia">Sepia</option><option value="sepia-dark">Sepia dark</option><option value="light">Light</option><option value="dark">Dark</option></select></li>
</ul>
</nav>
</header>
<footer class="site-footer">
<p class="eyebrow">
<a href="/">Silas Jelley</a>
<a href="/feeds" title="Every feed on the site">Feeds</a>
<a href="/about">About</a>
<a href="/contact">Contact</a>
<a href="#top">Top ↑</a>
</p>
</footer>
</div>
<script xmlns="http://www.w3.org/1999/xhtml" src="/js/theme.js?04109bde1f72"></script>
<script xmlns="http://www.w3.org/1999/xhtml" src="/js/feed.js?aeaf63aa0cfc"></script>
</feed>