20191119 Cloud Native Java : GraalVM

Copyright © 2019 Oracle and/or its affiliates1
Taewan Kim (@taewanme, http://taewan.kim)
Principal Solution Engineer
Cloud Excellence Team / Oracle Korea
Oracle Modern Cloud Day
Cloud Native Java: GraalVM
2019-11-19

Safe Harbor
The following is intended to outline our general product direction. It is intended for information purposes only, and may not
be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be
relied upon in making purchasing decisions. The development, release, timing, and pricing of any features or functionality
described for Oracle’s products may change and remains at the sole discretion of Oracle Corporation.
Statements in this presentation relating to Oracle’s future plans, expectations, beliefs, intentions and prospects are “forward-
looking statements” and are subject to material risks and uncertainties. A detailed discussion of these factors and other risks
that affect our business is contained in Oracle’s Securities and Exchange Commission (SEC) filings, including our most recent
reports on Form 10-K and Form 10-Q under the heading “Risk Factors.” These filings are available on the SEC’s website or
on Oracle’s website at http://www.oracle.com/investor. All information in this presentation is current as of September 2019
and Oracle undertakes no duty to update any statement in light of new information or future events.

What is GraalVM?
Index
1
2
3
4
5
Feature 1: High Performance Java
Feature 2: Language Interoperability
Feature 3 : Fast Startup – Native Image
Usecase
6 OCI + GraalVM

• What is GraalVM?
• Feature 1: High Performance Java
• Feature 2: Language Interoperability
• Feature 3 : Fast Startup – Native Image
• Usecase
• OCI + GraalVM

Java Standard Edition JDK(Java Development Kit)
고성능 자바
개발언어 수준
상호 운용성
빠른 실행
New JIT Compiler:
Graal
Java, R, JavaScript, Ruby,
C, C++, Rust, Python ….
native-image
Java for Cloud Native
Community Edition
Enterprise Edition
Version: 19.2.1
www.graalvm.org
Java 8 & Java 11(P)

GraalVM CE vs. GraalVM EE

• Free
• Community Support
• Commercial - Subscription
• Supported Enterprise Support
• Native Code Memory Protection
• GraalVM EE upto 25% than GraalVM CE
• Free on OCI(OCI Cloud)

• Usecase
• OCI + GraalVM

Java Performance Enhancement
1995 1996 1998 2000 2002 2004 2006 2007 2014 2017 2018.3 2018.9 2019.3 2019.9
Beta
Java
1.0
Java
1.2
Java
1.3
Java
1.4
Java
5
Java
6
Java
7
Java
8
Java
9
Java
10
Java
11
Java
12
Java
13
Java
Java VM 성능 향상 요소
• Garbage Collection 알고리즘
• Runtime 메모리 구조 개선
• Java Library 효율성 향상
• CPU 최적화
• JIT(Just-in-Time) 컴파일러

Performance Matrices
Startup Speed
Peak Throughput
Low Memory
Footprint
Reduced Max
Latency
단위 시간당 최대 처리량
지연시간 최소화
패키지 파일 용량
낮은 메모리 사용량
빠른 시작 시간
Small Packaging

GraalVM의 성능 개선
JIT(Just-in-Time)
Compiler

Execution Engine
Javac & JIT(Just-in-Time) Compiler
Java Source File Java bytecode File
jar file
javac (compile) jar(packing)
@Compile
Time
@Run Time (JVM)
Runtime Data Area Machine
Code
/
Native
Code
Class
Loader
JIT
Gabage
Collector
13
Filesystem

Execution Engine
Javac & JIT(Just-in-Time) Compiler
Java Source File Java bytecode File
jar file
javac (compile) jar(packing)
@Compile
Time
@Run Time (JVM)
Runtime Data Area
Machine
Code
/
Native
Code
Class
Loader
Method
Area
Heap
Stack
Area
Program
Counter
Registers
Native
Method
Stack
JIT ProfilerIR Generator
Optimizer Code Generator
Gabage
Collector
Filesystem

Execution Engine
JIT Compiler | Optimizer
JVM Runtime Data Area
Class
Loader JIT ProfilerIR Generator
Code Generator
Gabage
Collector
long count = 0, sum = 0;
for (int i = 0; i < persons.length;
i++) {
Person person = persons[i];
int age = person.age;
if (person.employment ==
Employment.EMPLOYED &&
person.salary > 100_000 && age >= 40) {
sum += age;
count += 1;
}
}
return (double) sum / count;
Arrays.stream(persons)
.filter(p -> p.getEmployment() ==
Employment.EMPLOYED)
.filter(p -> p.getSalary() > 100_000)
.mapToInt(Person::getAge)
.filter(age -> age >= 40).average()
.getAsDouble();
Code Optimization
Optimizer

= + 𝜶

= + 𝜶
HotSpot VM
C1 C2
Compiler Interface
OpenJDK 8
C++ C++

HotSpot VM
C1 C2
Compiler Interface
OpenJDK 8
C++ C++
= + 𝜶

HotSpot VM
C1 C2
Compiler Interface
OpenJDK 8
HotSpot VM
Compiler Interface JVMCI
C1 Graal
GraalVM
C++ C++ JavaC++
= + 𝜶

Graal & C2 성능 비교
Graal Compiler
C2 Compiler

Iteration 1: 11.961 ns/op
Graal Compiler
C2 Compiler
≪

• Usecase
• OCI + GraalVM

1995 Write once, Run anywhere

JVM JVM JVM

2010 ~
• Cloud Infra
• Open Source
https://landscape.cncf.io/zoom=60

2013 One VM to rule them all

Polyglot Language Platform
GraalVM Compiler
Java HotSpot VM
Truffle Framework
GraalVM interpreter GraalVM LLVM
bitcode interpreter

Java
{Java, R} ∈ Node.js

Spring(Java) & R
Java

• Usecase
• OCI + GraalVM

Performance Matrices for JIT
Low Memory
Footprint
Reduced Max
Latency
Small Packaging
JIT
Startup Speed Peak Throughput

Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT
Performance Matrices for AOT

AOT mode: Native Image
@Second Compile Time with native-image
Substrate VM
Heap Image
Machine Code
실행 코드 생성
컴파일러
<GRAALVM_HOME>/bin/native-image
실행 파일
Executables
$ javac ExtListDir.java
$ native-imgae ExtListDir
$ ./exitlistdir
exitlistdir

ExtListDir 성능 비교
Native modeGraal mode

ExtListDir 성능 비교
Native modeGraal mode
0.126s 0.037s<<

Substrate VM
Heap Image
Machine Code
실행 코드 생성
컴파일러
<GRAALVM_HOME>/bin/native-image
실행 파일
Executables
$ javac ExtListDir.java
$ native-imgae ExtListDir
$ ./exitlistdir
exitlistdir

Class
Loader
Substrate VM
Heap Image
Machine Code
정적 코드 분석
클래스 로딩 및 초기화
<static block>
• heap snapshot
• AOT-compile code
Executables

Class
Loader
Execution Engine
Gabage
Collector
@Run Time (JVM)
Runtime Data Area
Method
Area
Heap
Stack
Area
Program
Counter
Registers
Native
Method
Stack
Substrate VM
Heap Image
Machine Code
Executables

Class
Loader
Execution Engine
Gabage
Collector
Runtime Data Area
Method
Area
Heap
Stack
Area
Program
Counter
Registers
Native
Method
Stack
Substrate VM
Heap
Image
Machine Code
Executables
@Run Time (JVM)

Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT
Performance Matrices for AOT
Substrate VM
Heap Image
Machine Code
Executables

Performance Matrices for AOT & JIT
Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT JIT

Final Goal of GraalVM AOT
Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT JIT

How to Run Application in JIT
JVM 실행 파일 로딩
Class Loader 클래스 파일 로딩
바이트 코드 검증
코드 해석
Fist Tier JIT 코드 컴파일 (C1)
머신코드 실행
프로파일 피드백 수집
Class Loader 클래스 파일 로딩
바이트 코드 검증
코드 해석
Second Tier JIT 코드 컴파일
(C2/Graal)
머신코드 실행
<After Switching JIT Compiler> >

How to Run Application in JIT
https://itu.dk/people/thdy/teaching/pcpp2019/Week_3/lecture.pdf
C1 Compiler C2 Compiler
프로파일

Native Image | Profile-Guided Optimization
Substrate VM
Heap Image
Machine Code
Executables File
$ java -Dgraal.PGOInstrument=myclass.iprof MyClass
$ native-image --pgo=myclass.iprof MyClass
native-image
--pgo-instrument Instrumented Binary
native-image --pgo Optimized Binary
Profiles (.iprof)
Relevant
Workloads

Quarkus Hibernate | PGO Native
0
2,000
4,000
6,000
8,000
10,000
12,000
14,000
16,000
18,000
1,000 10,000 100,000 1,000,000 10,000,000
Cumulative number of requests sent by ApacheBench
Native Image JDK 8, Java HotSpot VM
Handled requests per second

Feature 3 : Fast Startup – Native Image
• Usecase
• OCI + GraalVM

Twitter | 20% 성능 개선 (GraalVM CE)
https://www.youtube.com/watch?v=ZbccuoaLChk

Language GPU Support Library
Python Numba, cuPy, PyCUDA
Java JCuda, jCUDA, CUDA4J
C/C++ CUDA C/C++
R gpuR, Rcpp
JavaScript gpu.js, node-cuda, cuda-ts
C# Hybridizer, ManagedCUDA, ILGPU
Ruby RbCUDA
GraalVM Compiler
Java HotSpot VM
Truffle Framework
GraalVM LLVM
bitcode interpreter
NVIDIA | grCUDA

Microprofile | 성능
940 ms
2101 ms
988 ms
952 ms
2087 ms
1030 ms
16 ms
37 ms
35 ms
0 ms 500 ms 1000 ms 1500 ms 2000 ms 2500 ms
Quarkus
Micronaut
Helidon
Native Image JDK 12 JDK 8

Microprofile | 메모리
121 MB
180 MB
106 MB
125 MB
172 MB
116 MB
17 MB
41 MB
31 MB
0 MB 20 MB 40 MB 60 MB 80 MB 100 MB 120 MB 140 MB 160 MB 180 MB 200 MB
Quarkus
Micronaut
Helidon
Maximum Memory Size
Native Image JDK 12 JDK 8

• Usecase
• OCI + GraalVM

FunctionsContainers
• Kubernetes
• PaaS
Virtual Machine/
Bare Metal
Oracle Cloud + GraalVM

Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT JIT
GraalVM | OCI VM

Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT JIT
GraalVM | OCI Container

Low Memory
Footprint
Reduced Max
Latency
Small Packaging
AOT JIT
GraalVM | OCI Function

GraalVM 세션 요약

Summary
고성능 자바
개발언어 수준
상호 운용성
빠른 실행
New JIT Compiler:
Graal
native-image
One VM to
Rule them
ALL (2013)
Community Edition
Enterprise Edition
Version: 19.2.1
www.graalvm.org
Java 8 & Java 11(P)

Summary | GraalVM 은 OOO 이다.
고성능 자바
개발언어 수준
상호 운용성
빠른 실행
New JIT Compiler:
Graal
native-image
One VM to
Rule them
ALL (2013)
Community Edition
Enterprise Edition
Version: 19.2.1
www.graalvm.org
Java 8 & Java 11(P)
#Standard-Java compatibility
#Extension Java for cloud
#Standardization Orientation
#Non-Standard Java

GraalVM 수석 개발자 Thomas Wuerthinger 세션
2019.12.14 13:00 Asem Tower 15층

Thank you
Taewan Kim
Solution Engineer
Cloud Excellence Team

20191119 Cloud Native Java : GraalVM

20191119 Cloud Native Java : GraalVM

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to 20191119 Cloud Native Java : GraalVM

Similar to 20191119 Cloud Native Java : GraalVM (20)

More from Taewan Kim

More from Taewan Kim (7)

Recently uploaded

Recently uploaded (20)

20191119 Cloud Native Java : GraalVM