Amazon Linux 2 provides a Linux distribution that integrates well with AWS, but the process from patch to package to push is not necessarily intuitive to our customers. Iliana Weller has been an engineer on Amazon Linux since 2014, and in this chalk talk, she discusses the lifecycle of changes making their way into Amazon Linux 2. She also covers the technical details of how we safely deploy repositories and images globally. This session is best for attendees with some familiarity with Amazon Linux (any version) and Linux package management.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Care and Feeding of
Amazon Linux
iliana weller (she/her)
Linux Witch
Containers and Linux, AWS
C O N 4 0 4

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Amazon Linux?

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is Amazon Linux?
• Linux operating system, optimized for AWS
• AWS feature launches and new Amazon Elastic Compute Cloud
(Amazon EC2) instance types from day 1
• Amazon Linux 2 released June 26, 2018
• Amazon Linux AMI (aka Amazon Linux 1) released 2011, EOL 2020
• Universal availability
• AMIs for use on Amazon EC2
• Container images
• On-premises virtualization images

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Lifecycle of a Linux distribution
Inspecting Amazon Linux source RPMs
Safely pushing Amazon Linux repositories
Building Linux container images and AMIs

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Online resources
https://iweller.people.a2z.com/con404/

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Lifecycle of a Linux distribution
Inspecting Amazon Linux source RPMs
Safely pushing Amazon Linux repositories
Building Linux container images and AMIs

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lifecycle of a Linux distribution
×

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lifecycle of Amazon Linux

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Lifecycle of a Linux distribution
Inspecting Amazon Linux source RPMs
Safely pushing Amazon Linux repositories
Building Linux container images and AMIs

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Inspecting source RPMs
$ sudo yum install -y yum-utils rpmdevtools
$ yumdownloader --source amazon-linux-extras
amazon-linux-extras-1.6.3-1.amzn2.src.rpm
$ rpmdev-extract amazon-linux-extras-1.7.3-1.amzn2.src.rpm
amazon-linux-extras-1.6.3-1.amzn2.src/amazon-linux-extras-1.6.3.tar.xz
amazon-linux-extras-1.6.3-1.amzn2.src/amazon-linux-extras.spec

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Inspecting source RPMs
$ sudo yum install -y yum-utils rpmdevtools
$ yumdownloader --source amazon-linux-extras
amazon-linux-extras-1.6.3-1.amzn2.src.rpm
$ rpmdev-extract amazon-linux-extras-1.7.3-1.amzn2.src.rpm
amazon-linux-extras-1.6.3-1.amzn2.src/amazon-linux-extras-1.6.3.tar.xz
amazon-linux-extras-1.6.3-1.amzn2.src/amazon-linux-extras.spec
Download a specific version:
$ yum list --show-duplicates amazon-linux-extras
$ yumdownloader --source amazon-linux-extras-1.6.2-1.amzn2
Compare two extracted source RPMs:
$ git diff --no-index old new # or your favorite diff tool of choice

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Lifecycle of a Linux distribution
Inspecting Amazon Linux source RPMs
Safely pushing Amazon Linux repositories
Building Linux container images and AMIs

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Anatomy of a Yum repository
• Optional mirror list: Refers Yum to a list of base URLs
• The base URL: Metadata and packages are prefixed with this URL
• repodata/repomd.xml: lists all metadata
• primary & primary_db: lists all packages
• filelists & filelists_db, other & other_db

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Anatomy of a Yum repository
• Optional mirror list: Refers Yum to a list of base URLs
• The base URL: Metadata and packages are prefixed with this URL
• repodata/repomd.xml: lists all metadata
• primary & primary_db: lists all packages
• filelists & filelists_db, other & other_db
• Yum repositories are just HTTP objects
• Amazon Linux repositories need to be in every region
• Hello, S3!

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Repository consistency

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tracing Yum’s steps
mirrorlist=http://amazonlinux.us-west-1.amazonaws.com/$releasever/$basearch/mirror.list

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tracing Yum’s steps
mirrorlist=http://amazonlinux.us-west-1.amazonaws.com/$releasever/$basearch/mirror.list
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/mirror.list

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tracing Yum’s steps
mirrorlist=http://amazonlinux.us-west-1.amazonaws.com/$releasever/$basearch/mirror.list
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/mirror.list
http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/e3b0c44298

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tracing Yum’s steps
mirrorlist=http://amazonlinux.us-west-1.amazonaws.com/$releasever/$basearch/mirror.list
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/mirror.list
http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/e3b0c44298
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/e3b0c44298/repodata/repomd.xml

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Tracing Yum’s steps
mirrorlist=http://amazonlinux.us-west-1.amazonaws.com/$releasever/$basearch/mirror.list
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/mirror.list
http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/e3b0c44298
$ curl http://amazonlinux.us-west-1.amazonaws.com/2/x86_64/e3b0c4429c/repodata/repomd.xml
<repomd xmlns="…">
<revision>1540504372</revision>
<data type="primary_db">
<checksum type="sha256">5622fe…</checksum>
<open-checksum type="sha256">a35e20…</open-checksum>
<location href="repodata/primary.sqlite.gz" />
<size>23412311</size>
</data>
…

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Efficient deployments

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Efficient deployments

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Lifecycle of a Linux distribution
Inspecting Amazon Linux source RPMs
Safely pushing Amazon Linux repositories
Building Linux container images and AMIs

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build a container image
1 IMAGE="amzn2-container-raw-2.0.$(date -u +%Y%m%d)-$(uname -p).tar.xz"
2 ROOT=$(mktemp -d)
3 yum --installroot=$ROOT --releasever=2 groupinstall -y container
4 rm -rf $ROOT/var/cache/yum/*
5 (cd $ROOT; tar -cJvf $OLDPWD/$IMAGE .)

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build a container image
1 IMAGE="amzn2-container-raw-2.0.$(date -u +%Y%m%d)-$(uname -p).tar.xz"
2 ROOT=$(mktemp -d)
3 yum --installroot=$ROOT --releasever=2 groupinstall -y container
4 rm -rf $ROOT/var/cache/yum/*
5 (cd $ROOT; tar -cJvf $OLDPWD/$IMAGE .)
20180501 x86_64

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build a container image
1 IMAGE="amzn2-container-raw-2.0.$(date -u +%Y%m%d)-$(uname -p).tar.xz"
2 ROOT=$(mktemp -d)
3 yum --installroot=$ROOT --releasever=2 groupinstall -y container
4 rm -rf $ROOT/var/cache/yum/*
5 (cd $ROOT; tar -cJvf $OLDPWD/$IMAGE .)

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build a container image
1 IMAGE="amzn2-container-raw-2.0.$(date -u +%Y%m%d)-$(uname -p).tar.xz"
2 ROOT=$(mktemp -d)
3 yum --installroot=$ROOT --releasever=2 groupinstall -y container
4 rm -rf $ROOT/var/cache/yum/*
5 (cd $ROOT; tar -cJvf $OLDPWD/$IMAGE .)
./
./bin
./boot/
./dev/
./dev/null
./etc/
./etc/aliases
[...]

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2
3
4
5 ROOT=$(mktemp -d)
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12
13
14 rm -rf $ROOT/var/cache/yum/*

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2
3 # Make a GPT partition table with an XFS partition
4
5 ROOT=$(mktemp -d)
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12
13
14 rm -rf $ROOT/var/cache/yum/*

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2
3 # Make a GPT partition table with an XFS partition
4
5 ROOT=$(mktemp -d)
6 # Mount the XFS partition at $ROOT
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12
13
14 rm -rf $ROOT/var/cache/yum/*

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2
3 # Make a GPT partition table with an XFS partition
4
5 ROOT=$(mktemp -d)
6 # Mount the XFS partition at $ROOT
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12
13
14 rm -rf $ROOT/var/cache/yum/* # then unmount everything

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2
3 # Make a GPT partition table with an XFS partition
4
5 ROOT=$(mktemp -d)
6 # Mount the XFS partition at $ROOT
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11 # Install a boot loader
12
13
14 rm -rf $ROOT/var/cache/yum/* # then unmount everything

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4
5 ROOT=$(mktemp -d)
6 # Mount the XFS partition at $ROOT
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11 # Install a boot loader
12
13
14 rm -rf $ROOT/var/cache/yum/* # then unmount everything

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
# gdisk $IMAGE
Command (? for help): n
Partition number (1-128, default 1): 1
First sector (34-4194270, default = 2048) or {+-}size{KMGTP}: 4096
Last sector (4096-4194270, default = 4194270) or {+-}size{KMGTP}:
Current type is 'Linux filesystem'
Hex code or GUID (L to show codes, Enter = 8300): 8300
Changed type of partition to 'Linux filesystem'

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
# gdisk $IMAGE
Command (? for help): n
Partition number (2-128, default 2): 128
First sector (34-4095, default = 2048) or {+-}size{KMGTP}: 2048
Last sector (2048-4095, default = 4095) or {+-}size{KMGTP}: 4095
Current type is 'Linux filesystem'
Hex code or GUID (L to show codes, Enter = 8300): ef02
Changed type of partition to 'BIOS boot partition'

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 # Make an XFS partition

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 # Make an XFS partition
KPARTX(8) Linux Administrator's Manual
NAME
kpartx - Create device maps from partition tables
EXAMPLE
To mount all the partitions in a raw disk image:
kpartx -av disk.img

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 # Make an XFS partition
KPARTX(8) Linux Administrator's Manual
EXAMPLE
This will output lines such as:
add map loop0p1 (253:0): 0 4190175 linear /dev/loop0 4096
The loop0p1 is the name of a device file under /dev/mapper which you can use
to access the partition, for example to fsck it:
fsck /dev/mapper/loop0p1

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 kpartx -avs $IMAGE

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11 # Install a boot loader
12
13
14 rm -rf $ROOT/var/cache/yum/*; umount $ROOT; kpartx -ds $IMAGE

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11 # Install a boot loader
12
13
14 rm -rf $ROOT/var/cache/yum/*; umount $ROOT; kpartx -ds $IMAGE

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount $ROOT; kpartx -ds $IMAGE

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6
7
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount $ROOT; kpartx -ds $IMAGE

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9
10
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9 # Write /etc/fstab
10 # Copy required configuration files
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 UUID=$(uuidgen); truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs -m uuid=$UUID $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9 echo "UUID=$UUID / xfs defaults,noatime 1 1" > $ROOT/etc/fstab
10 # Copy required configuration files
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 UUID=$(uuidgen); truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs -m uuid=$UUID $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9 echo "UUID=$UUID / xfs defaults,noatime 1 1" > $ROOT/etc/fstab
10 # Copy required configuration files
11
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 UUID=$(uuidgen); truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs -m uuid=$UUID $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9 echo "UUID=$UUID / xfs defaults,noatime 1 1" > $ROOT/etc/fstab
10 for f in /etc/sysconfig/network /etc/sysconfig/network-scripts/{ifcfg,route}-eth0
11 /etc/default/grub /etc/selinux/config; do cp -f $f $ROOT$f; done
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let’s build an AMI
1 IMAGE="amzn2-ami-minimal-hvm-2.0.$(date -u +%Y%m%d)-$(uname -p).xfs.gpt"
2 UUID=$(uuidgen); truncate -s 2G $IMAGE
3 sgdisk --clear -n 1:4096:0 -t 1:8300 -n 128:2048:4095 -t 128:ef02 $IMAGE
4 DEV=/dev/mapper/$(kpartx -avs $IMAGE | head -n 1 | awk '{ print $3 }')
5 mkfs.xfs -m uuid=$UUID $DEV; ROOT=$(mktemp -d); mount -o discard $DEV $ROOT
6 mkdir $ROOT/{dev,proc,sys}; mount -t devtmpfs devtmpfs $ROOT/dev;
7 mount -t proc proc $ROOT/proc; mount -t sysfs sysfs $ROOT/sys
8 yum --installroot=$ROOT --releasever=2 groupinstall -y ami-minimal
9 echo "UUID=$UUID / xfs defaults,noatime 1 1" > $ROOT/etc/fstab
10 for f in /etc/sysconfig/network /etc/sysconfig/network-scripts/{ifcfg,route}-eth0
11 /etc/default/grub /etc/selinux/config; do cp -f $f $ROOT$f; done
12 chroot $ROOT grub2-install /dev/$(sed -rn 's/^.*(loop[0-9]+).*$/1/p' <<<$DEV)
13 chroot $ROOT grub2-mkconfig -o /boot/grub2/grub.cfg
14 rm -rf $ROOT/var/cache/yum/*; umount --recursive $ROOT; kpartx -ds $IMAGE

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Online resources
https://iweller.people.a2z.com/con404/

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A brief note before we finish—
• Session surveys provide valuable information to speakers
• Feedback that is very helpful:
• Topics you were excited to learn about
• Suggestions for improving understanding and clarity
• Feedback that is extremely unhelpful:
• Comments unrelated to talk content (please refer to the AWS re:Invent Code of Conduct)
• The “hallway track” is always open!
• Feedback and questions welcome (iweller@amazon.com)
• For support, use the AWS Forums or contact AWS Support

59. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
iliana weller (she/her)
iweller@amazon.com
@ilianaweller

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.