A framework for the creative use and re-use of sound

1. 2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
1
Research
data
spring
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
27/2/2015
Sound
Matters
a
framework
for
the
creative
use
and
re-­‐use
of
sound

2. Link
to
VIDEO:
https://vimeo.com/28416673
Link
to
Interface:
http://ximenaalarcon.net/soundingunderground/environment/sounding.html

4. Research
Context

5. Problems
» Lack
of
understanding
of
the
value
of
sound
data
as
container
of
knowledge
» Lack
of
sound
specific
contextual
metadata
» Lack
of
accesible
sonic
information
retrieval
tools
» Lack
of
interfaces
for
relational
playback
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
5

6. Solution
» A
framework
for
the
use
and
re-­‐use
of
sound
that
facilitates
the
interrogation
and
relational
playback
of
non-­‐musical
sound
material
specifically
field
recordings
and
speech
A
Listening-­‐Led
Environment
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
6

7. Model
INTERROGATION
a.
Search
and
Retrieval
(meta-­‐data)
b.
Analysis
(machine-­‐led
listening)
sonic
information
retrieval
I
I
Sonic
inputs
I/
composed
outputs
-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐!
ARCHIVE/DATABASE-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐-­‐!
/I
I
I
RELATIONAL
PLAYBACK
(human-­‐led
listening)
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
7

8. Outputs,
milestones
and
indicators
of
success
» Stage
1:
Identifying
users’
needs
and
technical
platforms
Activities:
• User
Survey
and
Tech
tool
review
• User
co-­‐design
workshop
• Technical
consultancy
gathering
(based
on
conversations
during
Sandpit
workshop
with
CLIPPER
(Glasgow
and
Open
University),
MediaHub
–
U
of
Edingburgh,
Open
Preservation
Foundation,
Nine
by
Nine,
QMUL)
and
others
Output:
Prototype
proposal
Funding
requested:
£19000
(Researchers,
Admin,
workshop
and
gathering
expenses)
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
8

9. Outputs,
milestones
and
indicators
of
success
» Stage
2:
Prototyping
and
user
testing
Activities:
• Test
of
technical
tools
for
search,
retrieval
and
relational
playback
• Collaboration
CLIPPER
• Conference
paper
for
“Sound,
Images
and
Data”
New
York
University
July
23-­‐25
Output:
Working
prototype
Funding
requested:
£31000
(Researchers,
Admin,
developer,
collaborators
expenses,
conference
expenses
x
2)
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
9

10. Outputs,
milestones
and
indicators
of
success
» Stage
3:
Full
development
of
phase
1
of
environment
(2
tools)
Activities:
• Full
development
of
environment
modeling
the
use
and
re-­‐use
of
two
types
of
sound:
field
recording
and
speech
• User
testing
• Public
academic
event
sharing
the
experience
• Showcase
at
JISC
• Conference
Paper
and
publication
Output:
Environment
with
2
tools
(field
recording
and
speech)
Funding
requested:
£45000
(Researchers,
Admin,
developer,
user
testing,
academic
event)
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
10

11. Impact
and
Benefits
» Expand
awareness
of
sonic
understanding
in
the
wider
research
community
and
beyond.
» Developed
framework
for
multidisciplinary
sound
specific
meta-­‐
data.
» Accessible
and
open
source
tool
for
the
retrieval
of
sound
specific
data
related
to
field
recordings
and
to
speech
» Development
of
an
interdisciplinary
community
of
users
for
sustainability
» A
working
interface
for
relational
playback
of
sound
that
offers
a
experimental
space
for
researchers
and
students
at
UK
HE
and
FE
institutions
to
interact
with
sound
in
a
holistic
and
sensorial
way
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
11

12. Team
Dr.
Ximena
Alarcon
–
Research
Fellow
CRiSAP
UAL
Prof.
Cathy
Lane
–
Co-­‐director
CRiSAP
UAL
CRiSAP
UAL
Administrator
Sound
specialists
back-­‐end
and
front-­‐end
developers
Possible
Collaborators:
CLIPPER
Project
British
Library
2/27/15
Sound
Matters:
a
framework
for
the
creative
use
and
re-­‐use
of
sound
12
Research
data
spring
27/2/2015