Planet London Python

we · but reverse on the salary

>>> items = [(1, 'B'), (1, 'A'), (2, 'A'), (0, 'B'), (0, 'a')]
>>> sorted(items)
[(0, 'B'), (0, 'a'), (1, 'A'), (1, 'B'), (2, 'A')]

>>> sorted(items, key=str.lower)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: descriptor 'lower' requires a 'str' object but received a 'tuple'

>>> sorted(items, key=lambda x: (x[0], x[1].lower()))
[(0, 'a'), (0, 'B'), (1, 'A'), (1, 'B'), (2, 'A')]

>>> peeps = [{'name': 'Bill', 'salary': 1000}, {'name': 'Bill', 'salary': 500}, {'name': 'Ted', 'salary': 500}]

>>> sorted(peeps, key=lambda x: (x['name'], x['salary']))
[{'salary': 500, 'name': 'Bill'}, {'salary': 1000, 'name': 'Bill'}, {'salary': 500, 'name': 'Ted'}]

>>> sorted(peeps, key=lambda x: (x['name'], -x['salary']))
[{'salary': 1000, 'name': 'Bill'}, {'salary': 500, 'name': 'Bill'}, {'salary': 500, 'name': 'Ted'}]

def sort_that_out(mess):
    IOLoop.instance().add_callback(mess.sort)

class TestSortingStuffOut(unittest.TestCase):

    def test_stuff_get_sorted(self):
        stuff = [3,2,1]
        sort_that_out(mess)
        self.assertEqual(mess, [1, 2, 3])

AssertionError: Lists differ: [3, 2, 1] != [1, 2, 3]

def test_stuff_get_sorted(self):
    stuff = [3,2,1]
    sort_that_out(stuff)
    IOLoop.instance().start()
    self.assertEqual(stuff, [1, 2, 3])

  File "/tmp/t.py", line 13, in test_stuff_get_sorted     
    IOLoop.instance().start()
  File "/usr/local/lib/python2.7/site-packages/tornado/ioloop.py", line 627, in start
     event_pairs = self._impl.poll(poll_timeout) 
KeyboardInterrupt 

def test_stuff_get_sorted(self):
    stuff = [3,2,1]

    sort_that_out(stuff)

    IOLoop.instance().add_callback(IOLoop.instance().stop)
    IOLoop.instance().start()

    self.assertEqual(stuff, [1, 2, 3])

.
 ---------------------------------------------------------------------- 
Ran 1 test in 0.001s

OK 

from django.views.generic.edit import CreateView
from django.contrib.auth.forms import UserCreationForm

urlpatterns = patterns('',
    url('^register/', CreateView.as_view(
            template_name='register.html',
            form_class=UserCreationForm,
            success_url='/'
    )),
    url('^accounts/', include('django.contrib.auth.urls')),

    # rest of your URLs as normal
)

HIGHESTMODSEQ
SELECT
--port
tox
python setup.py test
pip install imapclient
<a href="#" style="color:pink :hover{color:red}">Sample Link</a>

>>> from premailer import transform
>>> print transform('''
... <html>
... <style>
... a { color: pink }
... a:hover { color: red }
... </style>
... <a href="#">Sample Link</a>
... </html>
... ''')
<html><head><a href="#" style="{color:pink} :hover{color:red}">Sample Link</a></head></html>

>>> from premailer import transform
>>> print transform('''
... <html>
... <style>
... a { color: pink }
... a:hover { color: red }
... </style>
... <a href="#">Sample Link</a>
... </html>
... ''')
<html><head>
<style>a:hover {color:red}</style>
<a href="#" style="color:pink">Sample Link</a>
</head></html>

import unittest

class BadAssError(TypeError):
    pass

def foo():
    raise BadAssError("d'oh")

class Test(unittest.TestCase):

    def test(self):
        self.assertRaises(BadAssError, foo)
        self.assertRaises(TypeError, foo)
        self.assertRaises(Exception, foo)

if __name__ == '__main__':
    unittest.main()

pip install imapclient
p.tag { color: blue; }
p { color: red; }

<p>Regular text</p>
<p class="tag">Special text</p>

<p style="color:red">Regular text</p>
<p style="color:blue; color:red" class="tag">Special text</p>

Average: 768.6 requests/second
Median: 773.5 requests/second
Standard deviation: 14.0

Average: 808.4 requests/second
Median: 816.4 requests/second
Standard deviation: 30.0

"@ianozsvald, you now support #IvoWertzel's tweet ...
parser! https://github.com/ianozsvald/"
reply: 'ianozsvald'
users: ['ianozsvald']
tags: ['IvoWertzel']
urls: ['https://github.com/ianozsvald/']
lists: []  # no lists in this tweet
output html: u'<a href="http://twitter.com/ianozsvald">@ianozsvald</a>, ...
  you now support <a href="http://search.twitter.com/search?q=%23IvoWertzel">#IvoWertzel</a>\'s
  tweet parser! <a href="https://github.com/ianozsvald/">https://github.com/ianozsvald/</a>'
/*
Stats about using github.com/peterbe/mincss
-------------------------------------------
Requests:         1 (now: 0)
Before:           81Kb
After:            11Kb
After (minified): 11Kb
Saving:           70Kb
*/
section{display:block}html{font-size:100%;-webkit-text-size-adjust:100%;-ms-tex...

from fancy_cache import cache_page

@cache_page(60 * 60)
def myview(request):
    ...
    return render(request, 'template.html', stuff)

for body in bodies:
    for each in CSSSelector(selector)(body):
        return True

var page = require('webpage').create();
page.open(phantom.args[0], function () {
  console.log(page.content);
  phantom.exit();
});

>>> from mincss.processor import Processor
>>> p = Processor()
>>> p.process_url('http://www.peterbe.com')
>>> p.process()
>>> p.inlines
[]
>>> p.links
[<mincss.processor.LinkResult object at 0x10a3bbe50>, <mincss.processor.LinkResult object at 0x10a4d4e90>]
>>> one = p.links[0]
>>> one.href
'//d1ac1bzf3lrf3c.cloudfront.net/static/CACHE/css/c98c3dfc8525.css'
>>> len(one.before)
83108
>>> len(one.after)
10062
>>> one.after[:70]
u'header {display:block}html{font-size:100%;-webkit-text-size-adjust:100'

$(function() {
  $.getJSON('/is-logged-in', function(res) {
    if (res.logged_in) {
      $('<div class="loggedin-footer">').appendTo($('#footer'));
    }
  });
});

pip install Flask
cd mincss/proxy
python app.py

pip install
imapclient
from utils import make_thumbnail
from rq import Queue
queue = Queue(connection=self.redis)
job = q.enqueue(
    make_thumbnail,
    image,
    width,
    extension,
    self.application.settings['static_path']
)

$ virtualenv testlibxml
 New python executable in testlibxml/bin/python
 Installing distribute.............................................................................................................................................................................................done.
 Installing pip...............done.
.../virtualenvs/testlibxml $ source bin/activate
$ pip install lxml
gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/home/ian/workspace/virtualenvs/testlibxml/build/lxml/src/lxml/includes -I/usr/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.linux-x86_64-2.7/src/lxml/lxml.etree.o
In file included from src/lxml/lxml.etree.c:254:0:
/home/ian/workspace/virtualenvs/testlibxml/build/lxml/src/lxml/includes/etree_defs.h:9:31: fatal error: libxml/xmlversion.h: No such file or directory
compilation terminated.
error: command 'gcc' failed with exit status 1
./configure --with-python=/home/ian/workspace/virtualenvs/testlibxml/bin/python
(testlibxml)ian@ian-Latitude-E6420 ~/workspace/virtualenvs/testlibxml $ python
 Python 2.7.3 (default, Aug  1 2012, 05:14:39)
 [GCC 4.6.3] on linux2
 Type "help", "copyright", "credits" or "license" for more information.
 >>> import libxml2 # works
import locale

def f1(n):
    locale.setlocale(locale.LC_ALL, 'en_US.UTF-8')
    return locale.format('%d', n, True)

def f2(n):
    r = []
    for i, c in enumerate(reversed(str(n))):
        if i and (not (i % 3)):
            r.insert(0, ',')
        r.insert(0, c)
    return ''.join(r)

assert f1(123456789) == '123,456,789'
assert f2(123456789) == '123,456,789'    

from time import time

for f in (f1, f2):
    t0 = time()
    for i in range(1000000):
        f(i)
    t1 = time()
    print f.func_name, t1 - t0, 'seconds'

peterbe@mpb:~$ python benchmark.py
f1 19.4571149349 seconds
f2 6.30253100395 seconds

peterbe@mpb:~$ pypy dummy.py
f1 14.367814064 seconds
f2 0.77246594429 seconds

import locale
locale.setlocale(locale.LC_ALL, 'en_US.UTF-8')
def f1(n):
    return locale.format('%d', n, True)

peterbe@mpb:~$ python dummy.py
f1 16.3811080456 seconds
f2 6.14097189903 seconds

def f3(i):
    return format(i, ',')

peterbe@mpb:~$ python dummy.py
f1 16.4227910042
f2 6.13625884056
f3 0.892002105713
peterbe@mpb:~$ pypy dummy.py
f1 4.61941003799
f2 0.720993041992
f3 0.26224398613

#!/usr/bin/python

import urllib2
import os
import json

URL = 'http://hastebin.com/documents'

def run(*args):
    if args:
        content = [open(x).read() for x in args]
        extensions = [os.path.splitext(x)[1] for x in args]
    else:
        content = [sys.stdin.read()]
        extensions = [None]

    for i, each in enumerate(content):
        req = urllib2.Request(URL, each)
        response = urllib2.urlopen(req)
        the_page = response.read()
        key = json.loads(the_page)['key']
        url = "http://hastebin.com/%s" % key
        if extensions[i]:
            url += extensions[i]
        print url

if __name__ == '__main__':
    import sys
    sys.exit(run(*sys.argv[1:]))

$ cat ~/myfile | hastebinit
$ hastebinit  ~/myfile
$ hastebinit ~/myfile myotherfile

#!/bin/bash
 
ZIPDIR="$HOME/docs/org"
 
read -s -p "Password:" key
 
cd $ZIPDIR
unzip -P $key passwords.zip passwords.txt -d $TMPDIR
if [[ $? != 0 ]] ; then
    exit 1
fi
 
cd "$TMPDIR"
touch passwords.datestamp
$EDITOR passwords.txt
if [[ passwords.txt -nt passwords.datestamp ]] ; then
    zip -P $key -r "$ZIPDIR/passwords.zip" passwords.txt
fi
 
rm passwords.txt
rm passwords.datestamp

Planet London Python

Demonstrating the first Brand Disambiguator (a hacky, crappy classifier that does something useful)

In Python you sort with a tuple

How to unit test tornado ioloop callbacks

Using the built-in views and forms for new user registration in Django

Python meets BoA

IMAPClient 0.10

Social Media Brand Disambiguator first steps

How Does Python Handle Signals (on Windows)?

premailer now excludes pseudo selectors by default

What to say about deployment?

A lovely review! "like sitting down to pair-program with the author"

Just in case you thought it was easy…

A Statement from Adria Richards

Raspberry Pi: driving a VU meter using a digital-to-analog converter

June project: Disambiguating “brands” in Social Media

Day against DRM and this book's copyright

So Long, and Thanks for All the Fish

Why Tuples?

Visualising London, Brighton and the UK using Geo-Tweets

More Python 3.3 downloads than Python 2.7 for past 3 months

Careful with your assertRaises() and inheritance of exceptions

Applied Parallel Computing (PyCon 2013 Tutorial) slides and code

IMAPClient 0.9.2

"Test Driven Development of Web Applications" -- the book exists, and is available on Early Release

Analysing #pydata, London and Brighton tweets for concept mapping

#PyData (PyData Santa Clara 2013)

London (geo-tagged tweets)

Brighton (geo-tagged tweets)

Reproducing this

premailer now honours specificity

Semantic map of PyCon2013 Twitter Topics

WebSocket for CherryPy 3.2

Use of VirtualBox to prepare students (PyCon tutorials)

django-fancy-cache with or without stats

Yesterday’s London Python Dojo

pip install : Lightspeed and Bulletproof

ANN: twitter-text-python 1.0.0.2 release (Python Tweet parsing library)

This site is now 100% inline CSS and no bytes are wasted

"TDD / Django tutorial: The Book!"

PART 1 - Beginning web app development with TDD

1: Our first functional test with Selenium

2: Getting Django set-up and running

3: A static front page

4: Super-users and the Django admin site

5: First unit tests and Database model

6: Testing a view

7: Django's template system

8: Reflections: what to test, what not to test

9: Simple Forms

10: User Authentication

11: More advanced forms

12: On Refactoring

13: Pagination

PART 2: More advanced testing for a more advanced site

14: Notifications

15: Adding style with MarkDown

16: Switching to OAuth: Mocking

17: Getting Dynamic: Testing Javascript part 1

18: Testing Javascript part 2 - Ajax

19: Getting pretty: Bootstrap

20: Getting pretty: Gravatar

PART 3: Getting seriously sexy

21: Getting serious about the client-side + single-page website?

22: Switching Databases 1: PostgreSQL

23: Websockets and Async on the server-side

24: Switching Databases 2: NoSQL and MongoDB

26: Continuous Integration

27: Caching for screamingly fast performance

Welcome to the world django-fancy-cache!

mincss version 0.8 is much much faster

PyCon Tutorial Notes for Applied Parallel Computing

Monitoring Audio Levels with PulseAudio

Applied Parallel Computing at PyCon 2013 (March)

mincss now support PhantomJS

mincss in action - sample report from the wild

mincss "Clears the junk out of your CSS"

The Great Thing About Open Source Is…

Map/Reduce (Disco) on millions of tweets

The next stage: writing a book