organise
Sync and Back Up Your Data with Conduit for Linux
Posted by Kevin Purdy at 2:00 AM on July 19, 2008

Admit it—even if your desk could be the cover shot for Organized Worker Monthly, your data is all over the place. Between desktop apps, online networks, and webapp tools, it's easy to lose track of data and duplicate tasks, simply because it's not all accessible, or it takes too much of your time to keep it all synced up and together. Conduit, an in-development program for the Linux desktop, makes it simple to link your web data, desktop files, and other information all together, then synchronise them all with a single click. Follow along as we check out how Conduit works, peek at its potential, and try out a few examples (and solicit your own clever ideas).
Getting started
If your Linux system's app-installing repository has a copy of Conduit that's at least at version 0.3.12, go ahead and install that. Otherwise, follow the links at the Conduit project page to add Conduit's PPA to your third-party sources, or grab a source package.Conduit's interface is meant to make data-syncing simple, and, for the most part, it does. Simply drag and drop icons that represent your data in the "cloud" (Flickr photos, YouTube Videos, Box.net backups, etc.) or your actual, physical stuff (files, folders, iPods, data apps) into the "canvas," and start making connections. Add the "sources" of your data first, followed by all the points that will receive it. Right-click on any item in your chain to configure it, whether that means pointing to specific folders or logging into your Flickr, Box.net, or Facebook accounts from pop-up windows. Here's a look at all the syncing tools you can play with in Conduit:

Once you've put a few of those items together, right-click on the "group" itself (the grey box surrounding the items) to change the syncing options. You can set up two-way sync between items that support it, a "slow sync" to free up your bandwidth, and a persistent "Always up to date" mode. You can also pre-set ways to deal with files already found, deleted on one side but not the other, and whether it should even bother looking at file creation dates to determine what's "new" (good for those of us who have made a few less-than-successful backup attempts).
Not every point on your data chain is fully two-way, unfortunately. I would've really liked to have created a Mega-Omni-RSS Feed for all my social networking updates; for now, I'll have to stick with Gina's Yahoo Pipes method. There are three basic data types in Conduit, distinguished by the little blue arrows on their icons:
One-way sources: You can only pull data from these items. Includes RSS feeds and music/playlist data from the Rhythmbox and Banshee music managers.
One-way sinks: You can drop data into these places. Backpack Notes, Facebook, and (disappointingly) Google Documents included.
Two-way items: The good stuff. Most web apps (Google Calendar & Contacts, Flickr, Box.net) support this, and if you're an Evolution user, your office gets a lot bigger.
The big drawback to Conduit, at the moment, is a lack of automatic, background synchronisation. The GUI version can keep an icon in the system tray with a "Synchronize now" option, but the real work-around is Conduit's command line functionality. Enter this into a console:
conduit-client -h You'll get a feel for the command line options you can plug into your preferred scheduling app, or you can just set Conduit to auto-start without showing its GUI.Great uses for Conduit
Conduit is far from a finished product, but it already allows some pretty nifty and simple backup and synchronisation hacks. Here's a few I was able to pull off fairly easily:
LSync Calendars, Contacts, and Notes with iPod/PDA
If a Linux system can detect and mount your iPod, Palm, or other data organizer, Conduit can sync up your calendars, contacts, and notes with it, wherever you have them stored—Google, Evolution, your Backpack notes, or even downloaded files. Simply plug in your device and hook up its separate calendar/contact/note items with your data.

Share once, publish across sites
Conduit works exceedingly smoothly with online photo sites, and its "Always up to date" feature means you can create a "Magic Folder"—drop a photo in it, and it gets picked up and sent out to all the sites you'd normally publish to.

YouTube/Podcast subscriptions made easy
Whatever you listen to your podcasts or watch videos with, Conduit can automatically grab the newest additions to a YouTube channel or podcast stream and drop them in a folder (or your Box.net space, your USB drive, iPod—you get the idea).

Simple folder sync/backup
The hardcore backup addicts will swear by using rsync to mirror files on any system, but Conduit makes what you're doing understandable and simple. Create a two-way sync to have any files on a USB drive auto-magically synced to a folder when plugged in. Back up and restore your files to a Box.net space, a web or FTP server, external hard drive, or anywhere else you can normally connect from your Linux system.

Your ideas
There's a lot of tools sitting in Conduit's left-hand pane, just waiting for you and your clever ideas to tweak into seriously cool uses. With the prevalence of RSS feeds generated from web apps, there are bound to be at least a few great work-arounds, useful filters, and other connections to be made.
So, let's hear it—What syncing ideas can you put into action with Conduit? What feature would you need to see installed for Total Data Awareness? Share it all in the comments—I'll update the post with some of the best sync chains as they roll in.
Kevin Purdy, associate editor at Lifehacker, sleeps easier when his data is neatly ordered and backed up. His feature Open Sourcery appears weekly on Lifehacker.
Tags: backup | conduit | linux | open sorcery | organise | sync

Comments (AU Comments · US Comments)
There are currently no AU comments for this post.
schmod
Posted 2:47 AM 19/7/08
This is seriously cool, and seems a lot like what Apple intended for Automater to be like.
The fact that it's out for linux *first* is also pretty awesome.
schmod
HChKn
Posted 3:00 AM 19/7/08
wow, totally reversed for my. My desk is filled with trash all the time while my files are perfectly ordered ;) It's just more easy to move the mouse than yourself.
HChKn
spidermedic
Posted 4:00 AM 19/7/08
Thanks for the heads up...0,3,6 is avail in the Ubuntu repos. Just loaded and getting ready to play!
spidermedic
sloped
Posted 4:48 AM 19/7/08
Cool, look forward to playing with it this weekend. I'm really interested in the calendar syncing. I've never been able to get evolution to work with multiple google calendars and if this was able to solve that problem I would be one happy geek.
sloped
rudle
Posted 4:40 AM 19/7/08
@huntaub: No, install Linux.
rudle
codeBLUE
Posted 4:34 AM 19/7/08
Looks awesome, I can't wait to throw it on my Linux box at home.
codeBLUE
huntaub
Posted 4:34 AM 19/7/08
Is there anything like this available for the mac?
huntaub
huntaub
Posted 5:20 AM 19/7/08
@rudle: alright sounds good! haha
huntaub
ElianaAmphithea
Posted 4:48 AM 19/7/08
For those of you who are running Ubuntu Hardy, the default version in the repository is not the newest version. However, if you go to the release pageon the
conduit website, you can download the newest version in source form.
Just extract the sources, cd to the appropriate folder, and run the
following:
sudo apt-get install checkinstall
sudo ./configure
sudo make
sudo checkinstall
Note that the first line is only necessary if you have never installed
checkinstall. This will configure the sources and make them. Checkinstall
will create a .deb in your working directory, then install that deb. That's
all there is to it.
crashsystems.net
ElianaAmphithea
AndiC
Posted 5:36 AM 19/7/08
@huntaub:
Yes i would like to see something for mac and windows as well
sync all my box's and the cloud.
Andi
AndiC
pcx339
Posted 5:29 AM 19/7/08
That looks very handy, like a web enabled version of | and >
{stares at Windows box}
Sigh... if only my crucial engineering apps were usable on linux.
pcx339
invid
Posted 5:25 AM 19/7/08
Nice! I'll have to try this out. I messed around with an earlier version of it and it seemed a bit sketchy.
invid
nsxstorm
Posted 6:00 AM 19/7/08
@pcx339:
I'm in the same boat. Sucks!
nsxstorm
Loodac
Posted 6:56 AM 19/7/08
Cool! I think I'll virtualize Ubuntu just to try this out! :D
Loodac
Rich Bradshaw
Posted 7:28 AM 19/7/08
Wow!
Sink should be Sync though, think thats wrong a couple of times.
This seems to be the best bit of software ever!
Rich Bradshaw
codeCowboy
Posted 8:02 AM 19/7/08
If you are running debian / ubuntu / mint the easiest way to install it is as a .deb package from:
[www.getdeb.net]
codeCowboy
muteboy
Posted 9:36 AM 19/7/08
I've played with this before - it must have been an earlier version, because it borked when drawing the right-hand-side of the conduit diagram.
Looking forward to trying it again!
muteboy
Daniel
Posted 11:23 AM 19/7/08
@ElianaAmphithea: No need to build manually. They provide a PPA so you can always have the most recent version.
Daniel
Daniel
ubuntugamer
Posted 12:16 PM 19/7/08
@codeCowboy: Not on ubuntu. It's in the repos
ubuntugamer
quarterframer
Posted 11:58 AM 20/7/08
I tried this awhile back and nothing worked. Tried the latest (from getdeb--the one in the Ubuntu repositories is an older release) and I still can't get it to work.
Tried syncing Tomboy notes to iPod notes, Google Docs to a local folder, and syncing two local folders. In all cases I get "Sychronized OK" notices, but... nothing happens.
Looks great in concept, but has anyone actually used this successfully?
quarterframer
Siraf
Posted 10:17 AM 21/7/08
@quarterframer: Use the latest source build. It seems that the interfacing gets broken on the server side (i.e. Amazon, Facebook changes their api) so the latest source usually accounts for this.
Siraf
ipaul0
Posted 4:46 PM 22/7/08
For Windows users, Aniosoft iPod to Computer is recommended to transfer files from iPod to computer. Aniosoft iTouch iPhone Backup can be used to transfer files from iTouch/iPhone to computer.
Download from the following websites:
[www.aniosoft.com]
ipaul0