Looking forward to PyCon 2010!

by Brian on February 17, 2010

On Thursday I’m making the yearly pilgrimage to PyCon in Atlanta. This will be my third year and I’m sure it’ll be better than ever.

For me the real highlights of this conference are the legendary open space sessions. The level of interaction and learning at these really sets it apart from other conferences. Last year I attended a number of crackers including one on Cassandra and big data scalability with Jonathan Ellis. It’s great to see that Jonathan is delivering a scheduled talk on database scalability, and I’m sure there will be a fair number of open space sessions dedicated to NoSQL databases.

Looking at the 2010 schedule these are my other top picks:

  1. Deployment, development, packaging, and a little bit of the cloud (Ian Bicking)
  2. Powerful Pythonic Patterns (Alex Martelli)
  3. Understanding the Python GIL (David Beazley)
  4. Mastering Team Play: Four powerful examples of composing Python tools (Raymond Hettinger)
  5. Unladen Swallow: fewer coconuts, faster Python (Collin Winter)

I’ll have my camera with me again this year so watch out for pics under the pycon and pycon2010 tags on Flickr.

{ 0 comments }

Twitter to blog script

by Brian on May 24, 2009

Twitter logoBased on an example provided with the Twitter library for Python I cobbled together the following script to add my latest tweets to this site. It’s called from a cron job that I run on an occasional basis. My script linkifies hashtags and @username tokens in tweets so that you can see search results or user information.

Why did I not use one of the WordPress widgets? Well writing scripts like this is fun, and some widgets don’t seem to play too well with my Thesis theme. One thing to note is that getting the shell script setup under some cron configurations can take a while if you aren’t using it on a regular basis. It’s operation is also different between Ubuntu Server and Joyent’s Accelerator platform.

Up next: a similar script to process my latest bookmarks on Delicious.com.

Main script (tweets.py)

#!/usr/bin/python

import codecs, re, getopt, sys, twitter

TEMPLATE = """
<li>
  <span class="twitter-text">%s</span>
  <span class="twitter-relative-created-at"><a href="http://twitter.com/%s/statuses/%s">Posted %s</a></span>
</li>
"""

def Usage():
  print 'Usage: %s [options] twitterid' % __file__
  print
  print '  This script fetches a users latest twitter update and stores'
  print '  the result in a file as an XHTML fragment'
  print
  print '  Options:'
  print '    --help -h : print this help'
  print '    --output : the output file [default: stdout]'

def FetchTwitter(user, output):
  assert user
  statuses = twitter.Api().GetUserTimeline(user=user, count=7)

  xhtml = []
  for status in statuses:
  	  status.text = Linkify(status.text)
  	  xhtml.append(TEMPLATE % (status.text, status.user.screen_name, status.id, status.relative_created_at))

  if output:
    Save(''.join(xhtml), output)
  else:
    print ''.join(xhtml)

def Linkify(tweet):
    tweet = re.sub(r'(\A|\s)@(\w+)', r'\1@\2', tweet)
    return re.sub(r'(\A|\s)#(\w+)', r'\1#\2', tweet)

def Save(xhtml, output):
  out = codecs.open(output, mode='w', encoding='utf-8',
                    errors='xmlcharrefreplace')
  out.write(xhtml)
  out.close()

def main():
  try:
    opts, args = getopt.gnu_getopt(sys.argv[1:], 'ho', ['help', 'output='])
  except getopt.GetoptError:
    Usage()
    sys.exit(2)
  try:
    user = args[0]
  except:
    Usage()
    sys.exit(2)
  output = None
  for o, a in opts:
    if o in ("-h", "--help"):
      Usage()
      sys.exit(2)
    if o in ("-o", "--output"):
      output = a
  FetchTwitter(user, output)

if __name__ == "__main__":
  main()

Shell script executed as cron job (tweets.sh)

/usr/bin/python /path/to/tweets.py brianly --output /path/to/output/twittertimeline.htm

{ Comments on this entry are closed }

Keeping files in sync with Dropbox

May 23, 2009

When you use more than one computer on a daily basis, keeping files in sync between them is a constant problem. I’m familiar with tools like Subversion and Mercurial that make it relatively easy to keep code in sync between machines, but these require explicit actions that I often want to control. When it comes [...]

Read the full article →

Get fast computers for your developers

March 8, 2009

I’ve just been through an office move at a client site and packing it up got me thinking about the choices that companies make for their staff when it comes to computer hardware. Most users can benefit in some way from having faster computers, with bigger screens, and better input peripherals. Corporations have a tendency [...]

Read the full article →

Essential Utility: htop

February 8, 2009

I’ve been rebuilding my Dell PowerEdge 830 server after a meltdown last week. This time I decided to go with Ubuntu Server 8.10 as the base operating system with Windows running under VMware Server 2.0.
Since this is a pretty small server, I’m always checking up on resource usage and top is a useful tool for [...]

Read the full article →

Weekly Links #2

January 26, 2009

Microsoft InfoMesa Project Whiteboard for your data
Fabric – like Capistrano but written in Python
A Visual Introduction to Screen
retlang – Google Code
Tim Sneath : The Bumper List of Windows 7 Secrets
update-engine – Google Code

Read the full article →