Adventures in versioning everything - from software to chip designs - from NVIDIA, where more than 90% of the company use Perforce as a single source of truth. An overview of the real-world advantages of the "monorepo" across development and operations teams, including lessons learned along the way.
Patterns for automating API delivery. API conference
The Rise of the Monorepo at NVIDIA
1. The World Leader in Visual Computing
The Rise of the
Monorepo at NVIDIA
or
“If it isn’t checked in,
it doesn’t exist”
2.
3. FACTS
Founded in 1993
Jen-Hsun Huang is co-founder,
president and CEO
Headquartered in Santa Clara, Calif.
Listed in 1999 on NASDAQ under the
symbol NVDA
Invented the GPU in 1999 and has
shipped more than 1 billion to date
$5.01 billion in revenue in TTM
~9,300 employees worldwide
~7,300 patent assets
4. PC
GeForce | Quadro
DATA CENTER
Tesla | GRID
MOBILE
Tegra | SHIELD
ENTERPRISE
VIRTUALIZATION
AUTONOMOUS
MACHINES
HPC & CLOUD
SERVICE PROVIDERSGAMING DESIGN
The World Leader in Visual Computing
5. The Evolution of NVIDIA
PC Gaming
GeForce
Enterprise
Workstation
Quadro
Tablets
Tegra
Auto
Tegra/VCM
Mobile Entertainment
SHIELD
Enterprise VDI
GRID vGPU
Enterprise
Remote Workstation
GRID VGX/VCA
Cloud Gaming
GRID
Enterprise
High Performance Computing (HPC)
CUDA/Tesla
NewComputingDevices
Gaming
Enterprise
2000 2005 2010 2016
9. GAMEWORKS: PUSHING
THE LIMITS OF GAMING
300 NVIDIA visual effects
engineers
Libraries, algorithms, tools for
game developers
Featured in 12 blockbuster titles
in 2015
11. GEFORCE NOW: AMAZING
GAMES ANYWHERE
“Netflix of games”
AAA titles delivered at 1080p 60fps
Streamed to SHIELD family of
devices
12. QUADRO: THE CHOICE
OF PROFESSIONALS
Enables professional designers to
bring their visions to life
90% workstation market share
Since 2009, every film nominated
for “Best Visual Effects” made
with NVIDIA
13.
14. Multi-Res Shading | VR SLI | Context Priority
Direct Mode | Front Buffer Rendering
VR: A REVOLUTIONARY
VISUAL COMPUTING
EXPERIENCE
Transforming gaming, design,
film, news
Requires powerful GPUs:
Oculus min-spec = enthusiast GPU
GameWorks VR: Software for VR
headset and game developers
15. BREAKTHOUGHS IN
MEDICAL IMAGING
GPUs are essential in medical
imaging
Power the GE Revolution CT
scanner
High-quality imagery while
reducing radiation by up to 82%
16. ACCELERATING SCIENCE
Researchers use GPUs to solve
the world’s biggest challenges
Work highlighted in leading
scientific journals
GTC: Annual developer
conference — best come together
to share their work
17. “The Three Breakthroughs that have Finally
Unleashed AI on the World”
GPUs ● Big data ● Better algorithms
“a bird perched on a branch of a tree”
ACCELERATING
ARTIFICIAL
INTELLIGENCE
GPU-powered machines trained to
recognize images, text, speech
Backbone of next-gen, magical
apps
Adobe, Alibaba, Baidu, Facebook,
Flickr Yahoo!, Google, Microsoft
18. PHYSICALLY BASED
RENDERING
Simulating light and materials to
mirror real-world conditions
Potential to eliminate the need
for physical prototypes
NVIDIA Iray and DesignWorks
software bringing PBR to millions
19. GRID: VIRTUALIZED
GRAPHICS IN THE
DATACENTER
Big data, global collaboration,
mobility, security fueling
enterprise virtualization
GRID enables any app to be
virtualized on any device
All major server and virtualization
companies offer GRID-enabled
products
21. A SUPERCOMPUTER FOR
AUTONOMOUS MACHINES
Bringing AI and machine learning to
a world of robots and drones
Jetson TX1 is the first embedded
computer designed to process deep
neural networks
1 TeraFLOPS in a credit-card sized
module
23. BY THE NUMBERS: P4 Infrastructure
63 RW (read/write) instances
12 RO (read-only) instances
125 Scratch instances
2 Broker instances
3 Broker mirrors
1 ICM instance (integrates w/ circuit/mask tools)
1 ICM RO instance
17 External instances (proxies of 3rd parties P4)
62 Proxies worldwide and 1k+ ports proxied
81 Physical servers
935 TB used on 21 volumes on 4 filers
24. TYPICAL P4 SERVER CONFIGURATION
HP DL380 Gen 9 running CentOS 6.x
2 Intel E5-2687v3 w/ 10 cores each at 3.1GHz
256 Gig RAM
2 10Gb NIC (a single dual port card)
1 HP P440/4GB FBWC RAID controller
1 SAS Expander
24 900GB 10k RPM 12G SAS 2.5” HDs
9TB Usable DAS from 22 drive RAID 10
25. BY THE NUMBERS: P4 Usage
8k Users (many not in Engineering)
933.3M Managed files
2.1B Revisions (2.3 revisions per file)
159 Different types of files stored
88.5M Transactions per day (average)
97.9k p4 submit operations per day (average)
47.5k Committed changes per day (average)
11M p4 sync operations per day (average)
751k “open” (add/edit/etc.) ops per day (average)
496k p4 edit operations per day (average)
117 Different p4 commands used
30. Server complex for hw team
p4hw
p4hw
failover
p4hw
checkpoint
user cmds
p4hw-ro
p4hw-ro
failover
p4hw-ro
checkpoint
user cmds
p4hw-pse
p4hw-pse
failover
p4hw-pse
checkpoint
user cmds
p4hw-broker
mirror1
p4hw-broker
mirror2
user cmds
p4hw-broker
31. Server complex for sw team
p4sw p4sw
checkpoint
user cmds
p4sw-ro
p4sw-analysis
p4sw
p4sw
failover
user cmds
p4sw-ro
failover
p4sw-ro
checkpoint
user cmds
p4sw-dvs
p4sw-dvs
failover
p4sw-dvs
checkpoint
p4sw-broker
mirror
user cmds
p4sw-analysis
p4sw-analysis-02
p4sw-analysis-03
p4sw-analysis-04
p4sw-analysis-05
user cmds
user cmds
user cmds
user cmds
user cmds
user cmds
p4sw-dvs-02
p4sw-dvs-02
failover
p4sw-dvs-02
checkpoint
user cmds
p4sw-buildbrain
p4sw-buildbrain
failover
p4sw-buildbrain
checkpoint
user cmds
p4sw-as2
p4sw-as2
failover
p4sw-as2
checkpoint
user cmds
p4sw-broker
32. Tools to manage Perforce
• P4NV – our CMDB
• Ansible
• Server provisioning scripts
• Elaborate stop/start and rotation scripts
• Shared versioned file storage
• Ease of access from all Perforce servers
• Support HA and DR
• PSE
33. Chip library design/release
Circuit Design
• Cadence Virtuoso/Composer
• IC Manage GDP
Circuit Release
• Internal verif scripts
• “p4 integrate”
Chip library build
• Continuous
• All models
• Full verification
Chip library release
• Four lib types
• Chip lead does integrate
• Multiple NetApp volumes
34. • NVIDIA is the world leader in visual computing
• Very complex Perforce environment enables our
engineering team to manage their files/code
• Perforce partners with us to support the complexity of
our growing business
+