Internet Lending 100 unit pilot survey results.

1. NYPL Mobile Hotspot Lending
100 Unit Test
Preliminary Metrics
July 2014

2. We have developed a logic model to identify how we
can measure impact against the programs 4 goals.
Indicators / Measures Goal 1 Goal 2 Goal 3 Goal 4 Source
By data tracking/capture:
# of devices lent, average length of loan X X Tally
% enrollment of eligible households X X Tally
% return enrollment of eligible households X X Tally
Hours of use, bandwidth used, nature of use (urls visited) X X ISP
Library online resource use - measured by urls visited X ISP
Educational online resource use - measured by urls categories
visited
X ISP
Cost per use (per $/household, $/mo) X Tally
Return rate (devices returned without damage/total devices lent
out)
X Tally
By survey:
# of household users (by age, income, employment status) X Survey
% of households intending to continue “library lent” internet
access
X Survey
# of households intending to purchase a computer post lend X Survey
# of households intending to internet service post lend X Survey
Level of satisfaction with and attitudes related to the service X Survey
Attitudes or perception of skills of participants understanding of
the Internet and computer skills (Confidence, Skills Learned,
new usage - comparators)
X Survey
Programs users are aware of that they did not know about before X Survey
Programs users have used X Survey
By other tracked data: (Anecdotal)
Commitments received by corporate partners X Tally
Commitments received by FCC for ongoing funding X Tally
Commitments received by other potential funders X Tally
Partner libraries sign on to pilot by end of year X Tally
Interest expressed by other cities/major library systems X Tally
2
Goal 1
Increase
students/household access
to at home broadband
internet
Goal 2
Raise digital exposure and
confidence
Goal 3
Increase engagement with
library-provided and/or
recommended learning
resources
Goal 4
Establish a scalable public
library model for tackling the
national digital divide

3. TALLY DATA
3

4. • A total of 106 households showed interest in the
program by completing a user interest form
• Of those who communicated interest, 84% were eligible
• A total of 91 households are participating in the pilot
(98% of those eligible)
• A total of 91 wireless routers and 50 Chromebooks were
loaned
Chromebooks were only made available to Out of School
Time (OST) students
• 34 households checked out both devices; 47 checked
out only the wireless router; and 6 checked out only the
Chromebook
• 47 participants are ESOL students at Bronx Library
Center (BLC); the remaining participants are parents of
OST students at Mott Haven (19), Highbridge (13), and
Port Richmond (12)
Lent
0 20 40 60
Wifi & Chromebook
WiFi
Chrome Book
Spanish
English
4
Goal 1
Increase students/household access to at home broadband
internet
NOTE:
• 37% of participating households primarily speak Spanish
• TechConnect not channel not tested

5. ISP DATA
5

6. There are three program goals measured through ISP
and survey data
6
Goal 1
Increase student/household access to at home broadband
internet
Goal 2
Raise digital exposure and confidence
Goal 3
Increase engagement with library-provided and/or
recommended learning resources

7. Activity measurement limitations and related
assumptions
7
Method: Activity measured by connections on a particular port.
We are not given full destination website addresses due to privacy regulations of the ISP.
We were provided the port labels of the destination networks. While not perfect, it does
provide a hint as to the nature of activity because certain activity (such as email,
streaming video, social media, gaming, chat and messaging) which occurs on uniquely
labeled ports.
Assumption: Chromebook Activity
The port traffic label SPDY we assume to be Google Chromebook traffic. Because we
lent Chromebooks to 50% of our participants that traffic may potentially skew the results
but only by 2%. “Google” activity for this analysis is essentially Chromebook/Google
Apps activity.
Assumption: Anonymous Traffic
We assume that the "Anonymous" traffic (traffic on ports commonly labeled "HTTP")
consists of Google traffic as well. Google owns roughly 68% of all web traffic so we
assume 68% of the "Anonymous" traffic is Google traffic as well.
NOTE:
For the 10K pilot, if we chooses Sprint, we will be able to route all traffic through a
monitoring service to intercept CIPA restricted sites (black listed web site categories.)
We will therefore, have greater visibility as to the category of traffic based on the full
address. This will be anonymous and in aggregate so we preserve privacy.

8. Users are spending an average of 3.19 hours online per day,
and most often at times when the library is closed (6PM – 12AM
local)
0
500000
1000000
1500000
2000000
2500000
3000000
3500000
12:00AM
1:00AM
2:00AM
3:00AM
4:00AM
5:00AM
6:00AM
7:00AM
8:00AM
9:00AM
10:00AM
11:00AM
12:00PM
1:00PM
2:00PM
3:00PM
4:00PM
5:00PM
6:00PM
7:00PM
8:00PM
9:00PM
10:00PM
11:00PM
Connections
Time of Day (UTC)
• Average Time on-line:
3.19 hours/day
• This equates to 191
minutes vs a single 40
minute session at
library during opening
hours
8
Goal 1
Increase students/household access to at home broadband
internet
Note: TIME of Day on chart is UTC so
subtract 3 hours for local time.

9. 0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
% Activity vs % Data Volume
% Traffic % Volume
Data
384.7 GB/mo
173.2 GB/mo
102.7 GB/mo
51.3 GB/mo
HH Usage GB/mo
4.23 GB/HH/mo
1.90 GB/HH/mo
1.13 GB/HH/mo
0.56 GB/HH/mo
Activity
Anonymous
YouTube
Encrypted
Video
9
Goal 1
Increase students/household access to at home broadband
internet
Goal 2
Raise digital exposure and confidence
We see healthy
traffic levels
around >9GB
per household
per month, most
of which is
anonymous

10. File Sharing, Social Media, YouTube, and Google Web Properties seem
to represent bulk of traceable activity online.
Anonymous
68%
File Sharing
14%
Encrypted
6%
Social Media
6%
YouTube
3%
Google
2% Entertainment
1%
95% of Traffic
Anonymous
File Sharing
Encrypted
Social Media
YouTube
Google
Entertainment
Anonymous
48%
YouTube
22%
Encrypted
13%
Video
6%
Social Media
5%
App Store
4% Entertainmen
t
1%
Music
1%
95% of Volume
Anonymous
YouTube
Encrypted
Video
Social Media
App Store
Entertainment
Music
10
Goal 2
Raise digital exposure and confidence

11. Usage of educational content is not measurable through ISP data for the 100
unit test, so we will rely on exit surveys to measure this goal
Anonymous
48%
YouTube
22%
Encrypted
13%
Video
6%
Social Media
5%
App Store
4%
Entertainment
1%
Music
1%
95% of Volume
Anonymous
YouTube
Encrypted
Video
Social Media
App Store
Entertainment
Music
For the 10K test, we will have the
ability to capture URL traffic
programmatically.
We could assume Khan Academy is
part of the YouTube activity for our
OST students. Other resources like
Mango for ESOL or Math Whiz or
NYPL are most likely masked due
to port labeling and lack of URL
logging.
11
Goal 3
Increase engagement with library-provided and/or
recommended learning resources

12. SURVEY DATA – PRELIMINARY
Survey data includes 23 responses from parents
with children participating in the library’s OST program.
12

13. Participants report an average of 2.2 adults and 1.6 children per
household, or an average of 3.8 total household users
52%
35%
13%
0%
10%
20%
30%
40%
50%
60%
1 2 3
%ofhouseholds
# of child users
Child Users (ages 5+) per
Household
22%
57%
9% 9%
4%
0%
10%
20%
30%
40%
50%
60%
1 2 3 4 5
%ofhouseholds
# of adult users
Adult Users per Household
13
Goal 1
Increase students/household access to at home broadband
internet
preliminary survey n = 23

14. 11%
50%
39%
0% 20% 40% 60%
$50K - 75K
$25K - 50K
Under $25K
% of households
Total Household Income
27%
55%
14%
5%
0% 20% 40% 60%
Employed full-
time
Employed part-
time
Not employed,
looking for work
Student
% of households
Employment Status – Head of
Household
14
Goal 1
Increase students/household access to at home broadband
internet
preliminary survey n = 23
Nearly all households report incomes under $50K, and less than one
third of all heads of household are employed full-time

15. The majority of respondents report that they have gained confidence in
both
their own and their children’s ability to use the Internet
26%
19%
43% 57%
30%
24%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Own Ability (Adult) Child's Ability
Much more confident
than before
More confident than
before
About as confident as
before
Since participating in the Internet Lending pilot
how confident are you in your own / your child’s ability to use the Internet?
15
Goal 2
Raise digital exposure and confidence
preliminary survey n = 23
**“Much less confident” and “less
confident” were also answer options

16. 39%
39%
43%
57%
70%
91%
0% 20% 40% 60% 80% 100%
Finding or applying for a job
Connecting with friends / family (e.g.…
Learning job-related skills
Keeping informed of current events
Checking information about child's…
Helping child with schoolwork
% of respondents
Nearly all respondents used the Internet to help their children with
schoolwork, and many used it for job-related purposes
In the past two months, have you used the
Internet
for any of the following reasons?
16
Goal 2
Raise digital exposure and confidence
preliminary survey n = 23

17. If offered Internet service for $10 / month, the majority of respondents
feel it is somewhat or very likely they would purchase it in the next six
months
How likely is it that you will purchase a computer
or Internet service in the next six months?
30%
10%
13%
19%
13%
13%
38%
30% 33%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Computer Internet Service
($10/month)
Very likely
Somewhat likely
Neither likely nor
unlikely
Somewhat unlikely
Very unlikely
17
Goal 2
Raise digital exposure and confidence
preliminary survey n = 23

18. The vast majority of respondents were promoters of both the library’s
wireless Internet and Chromebook services
90%
10%
NPS – Internet Service
Promoter
Detractor
Passive
Net Promoter Score = 80
96%
4%
NPS – Chromebook
Promoter
Detractor
Passive
Net Promoter Score = 96
18
Goal 2
Raise digital exposure and confidence
preliminary survey n = 23
Net Promoter measures the likelihood of patrons recommending our services to a friend or coworker by asking,
“on a scale of 0 to 10 (10 being the highest and 0 being the lowest), how likely are you to recommend (X) to a
friend or colleague?” Promoters are people who select 9 or 10, passives 8 or 7, and detractors those who picked 0
through 6. The Net promoter score is then calculated by subtracting the % of promoters by the % of detractors.

19. Nearly all households intend to renew their devices
19
Goal 2
Raise digital exposure and confidence
preliminary survey n = 23
How likely is it that you will renew the device
after the current loan period ends?
5% 5%
5%
5% 10%
85% 86%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Wireless Router Chromebook
Very likely
Somewhat likely
Neither likely nor
unlikely
Somewhat unlikely
Very unlikely

20. 18% 14%
23%
9% 9%
9%
27% 32%
41%
36% 32%
14%
9% 14% 14%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Khan
Academy
Math Whiz Power My
Learning
In the past two months, how often did your child visit
the following websites?
Daily or more
A few times a
week
Once a week
20
Goal 3
Increase engagement with library-provided and/or
recommended learning resources
preliminary survey n = 23
Respondents indicated frequent usage of all three library-
recommended learning resources included in the survey