The Echo Nest workshop for Boston Music Hack Day

API Workshop
November 21, 2010
Paul Lamere
paul@echonest.com

Friday, November 20, 2009

listening reading

World of Music Audio learning World of Music Text

Solutions

WHAT THE ECHO NEST DOES


READING
Artist
• Tag Cloud
• Similar Artists
• Familiarity
• Hotttnesss
• News
• Audio
• Images
• Video
• Reviews
• Biography


Track
LISTENING •Tempo
• Key
Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O Dm7 G7 CM7 C#O

• Time Signature
x 10
4
• Mode
• Sections
2

1
wave form

0

• Pitch
! -1

! -2
0 2 4 6 8 10 12 14 16

• Timbre
1
0.8 25
auditory spectrogram
loudness

0.6 20

0.4

• Tatums
15
0.2
10
0
0 2 4 6 8 10 12 14 16
5

25

• Beats
1
0 0.5 1 1.5 2 sec.
20
spectrogram

1
auditory

15
0.8
10
segmentation

• Bars
5 0.6

1
0 2 4 0.4 6 8 10 12 14 16

0.2
B

• Duration
A
0
chromagram

0 0.5 1 20 1.5 2 sec.
G
B
A#
E
A 40
D
pitch features

• Loudness
G#
C G

0 2 4 F# 6 8 10 6012 14 16
F
E
B
segment-synchronous

D#
D 80
A

• Metadata
chromagram

C#
G C
0 0.5 1 1.5 2 sec.
100
E 25
D
20 120
timbre features

C

• Segments
0 2 4 6 8 10 12 14 16
15
140
10

• Fade in
5 160

1
2 4 6 8 10 12 14 16 segments
180

• Fade out
200

220

20 40 60 80 100 120 140 160 180 200 220


developer.echonest.com

Query:
http://developer.echonest.com/api/get_similar
?api_key=YOUR_API_KEY
&id=music://id.echonest.com/~/AR/AR2UWUD1187B9B3B01&rows=3
&version=3
Response:


CLIENT LIBRARIES
Echo Nest
Remix
Java
3RD PARTY
Cocoa
Pyechonest Flash Ruby
Processing

Echo Nest Web Services
http://developer.echonest.com/pages/resources

The Echo Nest
Artist API


Get your gaga on ... from python

>> from pyechonest import artist
>>
>> gaga = artist.search_artists(‘Lady Gaga’)[0]
>> gaga
<Artist ‘Lady Gaga’>

>> gaga.hotttnesss()
0.86328906000000005

>> gaga.similar(2)
[<Artist 'Ashley Tisdale'>, <Artist 'Britney Spears'>]


ARTIST RADIO IN TEN LINES OF CODE

def wander(band, max=10):
""" generate a playlist by wandering a seed artist neighborhood """
played = []
while max:
if band.audio():
audio = random.choice(band.audio())
if audio['url'] not in played:
play(audio)
played.append(audio['url'])
max -= 1
band = random.choice(band.similar())


Find Weezer’s neighbors in Java
ArtistAPI artistAPI = new ArtistAPI(MY_ECHO_NEST_API_KEY);
List<Artist> artists = artistAPI.searchArtist("Weezer”, false);
if (artists.size() > 0) {
for (Artist artist : artists) {
List<Scored<Artist>> similars =
artistAPI.getSimilarArtists(artist, 0, 10);
for (Scored<Artist> simArtist : similars) {
System.out.println(" " + simArtist.getItem());
}
}
}


Things you can build with
The Echo Nest
Artist API


PLAYLISTING


More engaging music discovery
The Music Exploration Space


The Echo Nest
Track API


25

20

15

10

5

1
0 0.5 1 1.5 2 sec.
1

0.8
segmentation

0.6

segments 0.4

0.2

0
0 0.5 1 1.5 2 sec.

B
A#
A
pitch features

G#
G

pitch features
F#
F
E
D#
D
C#
C
0 0.5 1 1.5 2 sec.

25

20
timbre features

15

timbre features 10

5

1
2 4 6 8 10 12 14 16 segments

JEHAN STYLE

4
x 10
2

1

0
beat markers
! -1

! -2
0 5 10 15 20 25
240
190

143

tempogram 114
96

72
60
0 5 10 15 20 25
1

0.8

0.6
tempo spectrum 0.4

0.2

0
60 72 96 114 143 190 240

JEHAN STYLE

ECHO NEST REMIX API

chop sound into:

Sections

Bars

Beats
ALL SONG
Segments ELEMENTS ARE
ITEMS IN A LIST

Delving into ‘Billie Jean’
>> from pyechonest import track
>>
>> t=track.upload("BillieJean.mp3")
>> t.tempo
{'confidence': 0.966, 'value': 116.944}

>> len(t.bars)
142

>> len(t.segments)
1259
>> t.segments[10]

{'duration': 0.252, 'loudness_begin': -46.009,
'loudness_end': -44.121, 'loudness_max': -30.931,
'pitches': [0.342, 0.873, 0.843, 1.0, 0.511, 0.432, 0.841,
0.432, 0.691, 0.687, 0.329, 0.672],
'start': 2.50204,
'timbre': [19.50, 130.611, -114.94, 112.246, 28.369, -60.277,
-23.689, -10.537, 4.514, 12.957, -25.44, 2.88],
'time_loudness_max': 0.0171}


Things you can build with
The Echo Nest
Track API


The Click Track Detector

Nirvana

Britney Spears

The Loudness war
The loss of dynamic range in modern recordings


MUSIC VISUALIZATION


Visualizing Kid-A
Song visualizations by using Echo Nest Analysis

Visualizations by Chris Mueller

Visualizing Song self similarity
The shape of the song

Madonna, Like A Prayer

Reich, Steve – Music for 18 Musicians: Pulses

Visualization by Chris Mueller

SYNCHSTEP

MATCH MUSIC TO YOUR PACE


Song visualization on the iPhone
Cocoa framework for the Echo Nest


Beethoven Hero
Synchronizing visualizations with music

By Anita Lillie

THE ECHO NEST REMIX API


>> song.segments
[segment, segment, segment...]
>> song.segments[10].start
34.502
>> song.segments[10].timbre
[-30.2, -10.4, 4.5, 3.2...]
>> song.segments[10].pitch
[0.5, 0.13, 1.0, .... ]

>> song.beats.reverse()

>> for i in segments:
i.stretch(2)
i = i + othersong.segment[12]

>> You can mix elements, time stretch them, detect & change pitch, move them
around, repeat them on downbeats, find a closest match in another song, detect and
modify volume envelopes, read/write mp3, aiff, wav

ALL SONG ELEMENTS ARE ITEMS IN A LIST

WHAT
THE ECHO NEST REMIX API
DOES


def one(input_filename, output_filename):
audiofile = audio.LocalAudioFile(input_filename)
bars = audiofile.analysis.bars
collect = audio.AudioQuantumList()
for bar in bars:
collect.append(bar.children()[0])
out = audio.getpieces(audiofile, collect)
out.encode(output_filename)


MAKE WEB SITES

Hyperingo

st = modify.Modify()
afile = audio.LocalAudioFile(in_filename)
beats = afile.analysis.beats
total = float(len(beats))
out_shape = (2*len(afile.data),)
for i, beat in enumerate(beats):
delta = i / total
new_ad = st.shiftTempo(afile[beat], 1 + delta / 2)
out_data.append(new_ad)
out_data.encode(out_filename)


I’ve always wanted to hear
Michael Jackson trying to sing
Amerie’s “One Thing”

-B.L.

MAKE MUSIC

Make a James Brown Machine

MAKE MUSIC

Let’s hear The Black Eyes Peas in 5/4.

-P.L.
MAKE MOVIES

The Echo Nest workshop for Boston Music Hack Day

Recommended

Recommended

More Related Content

Recently uploaded

Recently uploaded (20)

Featured

Featured (20)

The Echo Nest workshop for Boston Music Hack Day