Finding things with DEVONthink

I’ve been a DEVONthink user for many years; it’s an amazing piece of software. Currently I’m using DEVONthink Pro Office because I use all of the higher level capabilities. Over the years, my database structure and workflow have gone through many changes. In this post I’ll describe my approach to finding things in DEVONthink.

Databases

At first, I dumped everything into a single database. Over time, however, I realized that finding things was difficult because of the number of false positives when searching. I roughly divide my databases between areas of responsibility. For example, I’m a director at two local music organizations; so I have separate databases for each of those groups. However, most of my material goes into a single database. It’s where all of the items of daily living go - bills, receipts, bookmarks, web clips, etc.

I do have an archive database. Although I don’t systematically move items into the archive, when I find items that I’m sure I won’t wish to see in my searches, I move them across to the archive.

Tags

Tags are among the most powerful feature of DEVONthink Pro Office. In fact, because of the way tags are implemented in DTPO, I have begun to dump most of my folder hierarchy. There are two main ways of storing items in DTPO: groups and tags. The problem with groups is that they allow items to exist only in a single area.1 Sometimes it’s hard to determine in advance where an item should go. For example, our health care provider sends monthly statements. Should they go in a bills folder, a folder for the provider, a medical folder?

DEVONthink Pro Office location tags

Instead of building deep structures of groups, I’ve become disciplined at building a hierarchical tag list and tagging every item systematically. The choice of tags is dictated by how I want to find things.2 To be an item, I should be able to ask a series of questions about it, the answers to which will narrow the field. Typical question words help me construct a hierarchy. Where becomes a location hierarchy. Now everything gets tagged with a location that lets me find items geographically. What is the largest tree; and it evolves constantly over time as I add new items and try to classify them. Who has two trees, a Vendor tree and a Person tree. I use either depending on which is appropriate to the item. When is answered by the file data metadata. Why becomes a Purpose tree which has branches for entities such as action, reference, etc. The how question is represented by a Source tree with items such as web, note, scan, email, etc.

Question Tag tree Example
Where location location_us_mn_rochester
What topic topic_financial_tax_2015
When none file creation date
Why purpose purpose_reference
Who vendor person topic_vendor_verizon, person_crustyclown
How source source_scan

Workflow

Every item that I collect goes into the global inbox. I make no attempt to tag or categorize the file at the initial collection point. In order to make collection even easier, I hae a folder on the Desktop titled “DT”. Anything that is saved there triggers a Hazel rule that moves the item to the DTPO global inbox. I check the global inbox daily and move items into destination databases according to the content. Most items go into the general purpose database that I call Leviathan.3

DEVONthink Pro Office inbox counts
Once an item is in the database inbox, the count of items shows up in the sidebar, acting as a trigger for me to get busy tagging items. Right now, almost every item will go into a reference group after tagging. Importantly, nothing gets out of the database inbox without being tagged.

Although everything goes into one large reference group, I still need to organize materials by project. That’s where my project tag tree comes into play. I create project tags for items that relate to a particular project. When materials come into the database that are related to that project, I tag them either directly in the information dialog or by dragging the items onto the tag in question. Finally, I create project smart groups based on the particular tag for that project.

This is my system for using DEVONthink Pro Office. In particular, it’s how I find things. HTH.


  1. That’s not completely true. You can duplicate (copy) and replicate (create aliases of) items between groups. ↩︎

  2. Hierarchical tags are a killer feature in DTPO because when you search against a tag, the entire hierarchy below it, if any, will also be taken into account. For more about hierarchical tags, see this post on the excellent Organizing Creativity blog blog. ↩︎

  3. Leviathan (לִוְיָתָן) is a sea monster mentioned in the Tanakh. It has come to mean any large creature. My general purpose database fits that description pretty well. ↩︎

First experience with astrophotography

(Sony A7 35/2.8 Zeiss)

Halema'uma'u eruption and stars

(Sony A7 35/2.8 Zeiss)

One of the great things about shooting with a camera like the Sony A7 that has an advanced sensor is that you can shoot astrophotographs with less noise that ever before. This comes into play with the inevitably long exposures you encounter when shooting the night sky. On a recent trip to view Kilauea volcano as we’ve done many times, I wondered if it might be possible to capture both the volcano and the star-filled sky in the same shot; so I began to research a bit on astrophotography. I’m by no means an expert; but I’ve learned a bit.

Equipment

I shot with a Sony A7 full-frame mirrorless camera. It’s got an excellent low noise sensor. At least [one reviewer] prefers the A7S because it’s larger pixel size allows this A7S’s sensor to capture more startlight. The published images do look amazing. I shot with a variety of lenses during my limited experience on Kilauea. Most of the images that I captured were shot with a wide angle, either the Zeiss/Sony 35/2.8 or a Voigtländer 15 mm Leica M-mount with a Metabones adapter. The wider the aperture, the better because it enables shorter exposures at lower ISO settings.

A tripod is essential for the long exposures used in astrophotography. I use a Gitzo Basalt tripod. It’s a little bulky if you’re planning on hiking a distance with it; but it solid and stable. I’ve taken it out on long hikes out to the active lava flows and it’s withstood a lot of abuse. You’ll want a proper head for the camera mount. I love the equipment from Really Right Stuff. It’s pricey; but their products are beautifully made and engineered to perfection. On top of the Gitzo, I use their BH-40 ballhead. Just so you know, you will need an Arca-Swiss bracket for the camera. On the A7, I was tempted to buy the Really Right Stuff bracket; but I opted for a well-made less expensive option this time around.

How I found this spot

We stayed one night at the historic Volcano House overlooking Halema’uma’u Crater. Since there’s a lava lake occupying a portion of the crater floor, I expected to see some nice incandescent glow after dark. Right on schedule, after sun began to fall, the glow became visible about a mile in the distance. But almost at the same time, as the sun slipped behind Mauna Loa, the temperatures began to fall and with the high dew points, clouds formed instantly in the cool air, nearly completely obscuring any views of crater. I packed up my gear and went to bed.

I woke up again at 1 AM to my alarm, peered outside and saw clear views of the glowing vent; so I packed my equipment and started hiking about a mile down to the steam vents. I ended up taking the wrong trail in the complete blackness; and while backtracking, the clouds and fog rolled in again. This time, visibility was reduced to a few feet. I eventually made it back to the room and slept another hour. At that point, I began consulting the Hawaii Volcanos Observatory webcams. I figured that if they were showing clear views of the vent, then I should be able to drive down to a point close enough to walk, fire off a few shots before the fog came in again. Sure enough, around 2:30 AM, I caught a glimpse of the vent looking sharp on the webcam. Again, I grabbed my gear and sped off in the Jeep. After about a 300 yard walk, I found a spot with a beautiful view of the glowing gasses. Every now and then you could catch the sound of the lava rumbling in the crater. It was a spectacular experience. Since the stars were out, my goal was to capture both the star field and the crater. So many of the photos were taken with the Voigtländer 15 mm Leica M-mount lens. It’s a so-so lens overall; but it certainly gave some nice sweeping views.

(Sony A7 15 mm ISO 6400, 15s)

Halema’uma’u eruption and stars

(Sony A7 15 mm ISO 6400, 15s)

Process

To capture the stars, you have to dial up the sensitivity. I bracketed for ISO settings. Most of the shots were taken at ISO 3200 or 6400. I chose not to use the Auto ISO setting out of concern that the algorithms might choose to ramp up up the sensitivity beyond the point where noise would limit the quality too greatly. Most of the images were shot wide-open to minimize the exposure length. Exposures are going to be several seconds long. With exposures that are very long, one risks star trails. Because the earth is rotating, the light from the stars will inscribe an arc on the image if the shutter is open too long. There is a heuristic for computing the maximum shutter opening duration as a function of the focal length of the lens. The so-called “Rule of 600” states that the maximum open shutter duration is 600 divided by the focal length of the lens.1 An experienced astrophotographer posted his web calculator at the Lonely Speck. With either the rule of thumb or the more sophisticated calculator, it’s just a starting point.

Focusing is difficult. You must use only manual focus. Since you are photographing objects that you may not be able to see with the naked eye, it is hard to focus in the same way you may be accustomed to normally. I would start by moving the focus ring to infinity, then trying to identify the brightest star to fine tune your focus on.

Since I didn’t have a remote release, I just used the timer function on the camera to delay the activation of the shutter. Since the exposures are so long, I’m not even sure how necessary that it.

Conclusions

It’s not difficult; but noise is an issue. Some of the images are noisier than I’d like. I’m anxious to try the Rokinon 24mm f/1.4 ED AS UMC2 and see if I can get the exposure times down a bit more.


  1. You can read a detailed discussion about the Rule of 600 here ↩︎

  2. This is a big bulky lens; but the author of the Lonely Speck regards it as ideal for astrophotography. You can read his review↩︎

Concatenating mp4 video files

I recently shot a recital with my Sony A7. While it’s a wonderful camera for stills and it produces some excellent video too, cameras like this are not meant for continuous video recording. There are limitations that are imposed by compression algorithm licensing requirements. And, it seems, there are limits that are imposed by thermal issues inside the camera.

To make a long story short, my A7 ended up giving me two video files instead of one for this event. What to do?

Dandelions and innocence

Spring has finally arrived in Minnesota. So have dandelions.

On one of our walks, my daughter ViolinGirl exclaimed how much she loved the yellow “daisies” that dot some lawns. She wished our lawn could be covered with these beautiful flowers.

What a strange circumstance! We begin life appreciating the random beauty of these “weeds.” But once we reach adulthood, neighborhood peer pressure and cultural expectations have us spraying toxic chemicals - to our own detriment, no less - to eradicate these cherished flowers.

Nietzsche and the sublime purposeless of music

Nietzsche at the piano

I have always been troubled in some ill-defined way by articles that assert the benefits of music in some tangible way. For example, kids with music training do better at math. (I don’t if that’s true or not; but you get the style of what I’m talking about.) The unwritten inference is something like this: “No one but a fool or the spectacularly talented would regard music as an economically-valid life path; but math might be. So have your kids play music so they will make good grades and get into an Ivy League school.”

Middle class economics and false dichotomies

Patricia Cohen’s piece “Middle Class, but Feeling Economically Insecure”1 published yesterday in the New York Times raises several discrepancies between the economics of the middle class and one’s identification with that group. Reading the comments on the article I was struck by how divided Americans’ points of view are when it comes to the middle class and the causes of its distress. Clearly middle class wages have stagnated in the years immediately preceding and following 9/11. As the article points out, the median income in the US has not risen since 2000. Many of the commenters point to this and the feeling of insecurity and dispensability as a source of middle class angst. Others, fewer in number, point to a change in the baseline spending level. One commenter sums it up this way:

Private virtues v. public life

Politics is hopeless arena in which to enact individual values. Commercial interest will always win because of the enormous cost of modern politics. As I’ve written before1 I think that voting is an inefficient way of effecting change in a way that aligns with personal values. Persons can only be elected when they affiliate themselves with a package of values whose source is largely commercial interest. For example, if I placed the highest values on a balanced federal budget, low defense spending, universal health care, and inclusive rights, who would I vote for?

Synchonizing DEVONthink databases across machines

This is how I do it. YMMV.

I’ve used DEVONthink since its early days. If you’re unfamiliar with DEVONthink, it’s a knowledge management tool that allows you to save information, tag it, cross-reference it and classify it. Since I use both a laptop and a desktop Mac Pro, I need to synchronize databases across machines. There are several ways to go about synchronization:

  • Direct connection This is not a bad option when both machines are turned on simultaneously and are connected to the same network.
  • Dropbox Obviously, you need a Dropbox account for this. Since databases can grow quite large, you may need a paid Dropbox account for it. I don’t like having my personal information in the cloud; so I don’t use this option.
  • WebDAV I don’t run a WebDAV server, so that was out.
  • Local sync store This was the best option for me, since I use BitTorrent Sync to synchronize certain content between machines using peer-to-peer connections.

Here’s how I do it.

Commerce and discrimination

Those darned Republicans just can’t catch a break these days. In the latest cultural eruption, the Indiana legislature passed a bill which its governor signed into law. The bill allows places of business to refuse to serve persons if doing would conflict with their sincerely-held religious beliefs. An avalanche of public outcry has Indiana’s governor making a hasty retreat.

Charles Blow of the New York Times weighs in about how we should deal with the juxtaposition of free exercise of religious beliefs and discrimination:

Spotlight-searchable pinboard bookmarks

I use the excellent, dependable Pinboard service for managing my bookmarks. A one-time fee gives you lifetime access to the service; and there is an API that has fostered an ecosystem of desktop and mobile apps that interact with the service. Of course, Safari can synchronize bookmarks among devices; but it doesn’t allow tagging. Since tagging is a major part of my workflow, Safari bookmarks don’t work for me.

So, here’s where pinboardspotlight.py comes in. It’s a relatively simple Python program that downloads your Pinboard bookmarks, writing them to local .webloc files and applying the tags you’ve used in the Pinboard metadata to the local files. Now you’re Pinboard bookmarks are searchable locally.