DOC/BuildVentoyFromSource.txt

   1
   2 ==========================================
   3 1. Compile Environment
   4 ==========================================
   5     My build environment is CentOS 7.8 x86_64. So here I first explain how to create the build environment from scratch.
   6     Ventoy is based on many open source projects, so the build environment is important. I suggest you first test it on a virtual machine.
   7
   8 1.1 Install CentOS 7.8
   9     I use CentOS-7-x86_64-Everything-2003.iso and select Minimal install
  10
  11 1.2 Install Packages
  12     yum install \
  13         libXpm net-tools bzip2 wget vim gcc gcc-c++ samba dos2unix glibc-devel glibc.i686 glibc-devel.i686 \
  14         mpfr.i686 mpfr-devel.i686 zlib.i686 rsync autogen autoconf automake libtool gettext* bison binutils \
  15         flex device-mapper-devel SDL libpciaccess libusb freetype freetype-devel gnu-free-* qemu-* virt-* \
  16         libvirt* vte* NetworkManager-bluetooth brlapi fuse-devel dejavu* gnu-efi* pesign shim \
  17         iscsi-initiator-utils grub2-tools zip nasm acpica-tools glibc-static zlib-static xorriso
  18
  19
  20
  21 ==========================================
  22 2. Download Source Code
  23 ==========================================
  24 2.1 Download Ventoy source code from GitHub and decompress it.
  25     Next I assume that you have unzipped the code into the /home directory (check /home/Ventoy-master/README.md file for the directory layout).
  26
  27 2.2 Download third-party source code and tool
  28
  29     https://www.fefe.de/dietlibc/dietlibc-0.34.tar.xz                    ===>  /home/Ventoy-master/DOC/dietlibc-0.34.tar.xz
  30     https://musl.libc.org/releases/musl-1.2.1.tar.gz                     ===>  /home/Ventoy-master/DOC/musl-1.2.1.tar.gz
  31     https://ftp.gnu.org/gnu/grub/grub-2.04.tar.xz                        ===>  /home/Ventoy-master/GRUB2/grub-2.04.tar.xz
  32     https://codeload.github.com/tianocore/edk2/zip/edk2-stable201911     ===>  /home/Ventoy-master/EDK2/edk2-edk2-stable201911.zip
  33     https://codeload.github.com/relan/exfat/zip/v1.3.0                   ===>  /home/Ventoy-master/ExFAT/exfat-1.3.0.zip
  34     https://codeload.github.com/libfuse/libfuse/zip/fuse-2.9.9           ===>  /home/Ventoy-master/ExFAT/libfuse-fuse-2.9.9.zip
  35     https://releases.linaro.org/components/toolchain/binaries/7.4-2019.02/aarch64-linux-gnu/gcc-linaro-7.4.1-2019.02-x86_64_aarch64-linux-gnu.tar.xz           ===>  /opt/gcc-linaro-7.4.1-2019.02-x86_64_aarch64-linux-gnu.tar.xz
  36     https://toolchains.bootlin.com/downloads/releases/toolchains/aarch64/tarballs/aarch64--uclibc--stable-2020.08-1.tar.bz2 ===> /opt/aarch64--uclibc--stable-2020.08-1.tar.bz2
  37     https://github.com/ventoy/vtoytoolchain/releases/download/1.0/mips-loongson-gcc7.3-2019.06-29-linux-gnu.tar.gz ===> /opt/mips-loongson-gcc7.3-2019.06-29-linux-gnu.tar.gz
  38     https://github.com/ventoy/musl-cross-make/releases/download/latest/output.tar.bz2 ===> /opt/output.tar.bz2
  39
  40
  41     http://www.tinycorelinux.net/11.x/x86_64/release/distribution_files/vmlinuz64 ===> /home/Ventoy-master/LiveCD/ISO/EFI/boot/vmlinuz64
  42     http://www.tinycorelinux.net/11.x/x86_64/release/distribution_files/corepure64.gz ===> /home/Ventoy-master/LiveCD/ISO/EFI/boot/corepure64.gz
  43     http://www.tinycorelinux.net/11.x/x86_64/release/distribution_files/modules64.gz ===> /home/Ventoy-master/LiveCD/ISO/EFI/boot/modules64.gz
  44
  45 2.3 Prepare third-party tools
  46     cd /home/Ventoy-master/DOC/
  47     tar xf musl-1.2.1.tar.gz
  48     cd musl-1.2.1
  49     ./configure && make install
  50
  51     tar xf /opt/gcc-linaro-7.4.1-2019.02-x86_64_aarch64-linux-gnu.tar.xz  -C /opt
  52     tar xf /opt/aarch64--uclibc--stable-2020.08-1.tar.bz2  -C /opt
  53     tar xf /opt/output.tar.bz2  -C /opt
  54     mv /opt/output /opt/mips64el-linux-musl-gcc730
  55
  56
  57 2.4 Set PATH environment
  58     export PATH=$PATH:/opt/gcc-linaro-7.4.1-2019.02-x86_64_aarch64-linux-gnu/bin:/opt/aarch64--uclibc--stable-2020.08-1/bin:/opt/mips64el-linux-musl-gcc730/bin
  59     better to add this line to /root/.bashrc and relogin as root
  60
  61
  62 ==========================================
  63 3. All in one script
  64 ==========================================
  65     I have made an all-in-one script `all_in_one.sh`. You can run this script to build and pack ventoy.
  66     If you want to compile a certain part separately, you can continue to refer to the later chapters of this text.
  67
  68     cd /home/Ventoy-master/INSTALL
  69     sh all_in_one.sh
  70
  71     It should be noted that:
  72     1. Only grub2/EDK2/IPXE will be recompiled in all_in_one.sh. Other parts contain binaries and are rarely modified, so will not be recompiled everytime.
  73        You can rebuild these parts separately if you want.
  74
  75     2. Some parts of Ventoy have a 32-bit and 64-bit version (like 4.9, 4.10, 4.11 follows)
  76        all_in_one.sh only builds the 64bit version of them. If you want to rebuild the 32bit verison, you should create a 32-bit CentOS environment and build them.
  77        Fortunately these parts are rarely modified, so you only need to build once or you can directly use the binaries I have built.
  78
  79     Besides, after a full compile and packaging, you can only build the part you modified (for example grub2) and run ventoy_pack.sh to generate the package.
  80
  81 ==========================================
  82 4. Build every part of Ventoy
  83 ==========================================
  84 4.1 == Build grub2 ==
  85     cd /home/Ventoy-master/GRUB2
  86     sh buildgrub.sh
  87
  88 4.2 == Build ipxe.krn ==
  89     cd /home/Ventoy-master/IPXE
  90     sh buildipxe.sh
  91
  92 4.3 == Build Ventoy2Disk.exe ==
  93     Ventoy2Disk.exe is the installer in Windows platform. And it must be built in Windows with Microsoft Visual Studio (2013+).
  94     Open /home/Ventoy-master/Ventoy2Disk/Ventoy2Disk.sln with Visual Studio and build it.
  95
  96 4.4 == Build vtoyjump64.exe/vtoyjump32.exe ==
  97     vtoyjump64.exe/vtoyjump32.exe is used to mount iso file in windows PE. You should install Microsoft Visual Studio (2013+) to build it.
  98     Open /home/Ventoy-master/vtoyjump/vtoyjump.sln with Visual Studio and build it (64&32).
  99
 100 4.5 == Build dmsetup ==
 101     Please refer to DMSETUP/build.txt
 102
 103 4.6 == Build ventoy_x64.efi ==
 104     cd /home/Ventoy-master/EDK2
 105     sh buildedk.sh
 106
 107 4.7 == Build VtoyTool ==
 108     cd /home/Ventoy-master/VtoyTool
 109     sh build.sh
 110
 111 4.8 == Build vtoycli ==
 112     cd /home/Ventoy-master/vtoycli/fat_io_lib
 113     sh buildlib.sh
 114     cd /home/Ventoy-master/vtoycli
 115     sh build.sh
 116
 117 4.9 == Build exfat-util ==
 118     cd /home/Ventoy-master/ExFAT
 119     sh buidlibfuse.sh
 120     sh buidexfat.sh
 121
 122     After that, copy EXFAT/shared/mkexfatfs         ===> /home/Ventoy-master/INSTALL/tool/mkexfatfs_64
 123     After that, copy EXFAT/shared/mount.exfat-fuse  ===> /home/Ventoy-master/INSTALL/tool/mount.exfat-fuse_64
 124
 125     Use the same build step to build exfat-util 32-bit in a 32-bit CentOS system and get mkexfatfs_32 and mount.exfat-fuse_32
 126
 127 4.10 == Build vtoy_fuse_iso_64/vtoy_fuse_iso_32 ==
 128     cd /home/Ventoy-master/FUSEISO
 129     sh build_libfuse.sh
 130     sh build.sh
 131
 132     Use the same build step to build in a 32-bit CentOS system and get vtoy_fuse_iso_32
 133
 134 4.11 == Build unsquashfs_64/unsquashfs_32 ==
 135     cd /home/Ventoy-master/SQUASHFS/SRC
 136     sh build_lz4.sh
 137     sh build_lzma.sh
 138     sh build_lzo.sh
 139     sh build_zstd.sh
 140
 141     cd /home/Ventoy-master/SQUASHFS/squashfs-tools-4.4/squashfs-tools
 142     sh build.sh
 143
 144     Use the same build step to build in a 32-bit CentOS system and get unsquashfs_32
 145
 146 4.12 == Build vblade_64/vblade_32 ==
 147     cd /home/Ventoy-master/VBLADE/vblade-master
 148     sh build.sh
 149
 150 4.13 == Build zstdcat ==
 151     Please refer to ZSTD/build.txt
 152
 153 4.14 == Build vtoy_gen_uuid ==
 154     cd /home/Ventoy-master/GenUUID
 155     sh build.sh
 156
 157 4.15 == Build xzminidec32 ==
 158    cd /home/Ventoy-master/Ventoy2Disk/Ventoy2Disk/xz-embedded-20130513/userspace
 159    make -f ventoy_makefile
 160    strip --strip-all xzminidec
 161
 162 4.16 == Build xzminidec64 ==
 163    cd /home/Ventoy-master/Ventoy2Disk/Ventoy2Disk/xz-embedded-20130513/userspace
 164    make -f ventoy_makefile64
 165    strip --strip-all xzminidec
 166
 167 4.17 == Build iso9660_x64.efi ==
 168    This efi driver is from https://github.com/pbatard/efifs
 169    Follow all the build instructions in this project. I modified 3 files (the original and modified source are at /home/Ventoy-master/EDK2/efiffs)
 170
 171 4.18 IMG/cpio/ventoy/busybox/64h
 172   https://www.uclibc.org/downloads/binaries/0.9.30.1/mini-native-x86_64.tar.bz2
 173   https://busybox.net/downloads/busybox-1.32.0.tar.bz2
 174   use BUSYBOX/x86_64_ash.config and uclibc to build busybox-1.32
 175
 176 4.19 == Build lunzip32/lunzip64 ==
 177   http://mirror.yongbok.net/nongnu/lzip/lunzip/lunzip-1.11.tar.gz
 178   PATH=$PATH:/opt/diet/bin
 179   ./configure --disable-nls CC='diet gcc -nostdinc'
 180   make
 181   strip --strip-all lunzip
 182
 183   #aarch64
 184   ./configure --disable-nls CC='aarch64-buildroot-linux-uclibc-gcc -static'
 185   make
 186   aarch64-buildroot-linux-uclibc-strip --strip-all lunzip
 187
 188
 189
 190 ==========================================
 191 5. Binaries
 192 ==========================================
 193   There some binaries in Ventoy install package. These files are downloaded from other open source project's website, such as busybox.
 194   Here is the list of the binaries, their SHA-256 and the download urls:
 195
 196 5.1 IMG/cpio/ventoy/tool/lz4cat
 197   https://create.stephan-brumme.com/smallz4   smallz4cat-x32-v1.4
 198   SHA-256: 13d293ddeedb469f51da41167f79b2cbdb904e681716f6e6191b233dbb162438
 199
 200 5.2 IMG/cpio/ventoy/tool/ar
 201   https://busybox.net/downloads/binaries/1.30.0-i686   busybox_AR
 202   SHA-256: f29b7d81a983c0c85d22496f4a833c18f2528a1b666eb7d47c93084c1ed66ae0
 203
 204 5.3 IMG/cpio/ventoy/tool/inotifyd
 205   https://busybox.net/downloads/binaries/1.30.0-i686   busybox_INOTIFYD
 206   SHA-256: 3532162a8695e91a1ed9ddea28b2cb22259a90e93d5d9c4a517b6c36842c686f
 207
 208 5.4 IMG/cpio/ventoy/busybox/ash
 209   https://busybox.net/downloads/binaries/1.27.1-i686   busybox_ASH
 210   SHA-256: 44a6274bca580c2758ffc173fc76d18bb855b1fe8dcf70efd9ee75cbd57dee97
 211
 212 5.5 IMG/cpio/ventoy/busybox/tmpxz
 213   https://busybox.net/downloads/binaries/1.27.1-i686   busybox_XZ
 214   SHA-256: f6cdb6293680424c29b89bde0685ca27f455166c9b302cd6082ef90681456291
 215
 216 5.6 INSTALL/tool/i386/xzcat
 217   https://busybox.net/downloads/binaries/1.30.0-i686/   busybox_XZCAT
 218   SHA-256: 7399db642c2beaf52a16ab5264ffc55cfd1ff5699a524f63e5d48edf84e20f44
 219
 220 5.7 INSTALL/tool/i386/hexdump
 221   https://busybox.net/downloads/binaries/1.30.0-i686/   busybox_HEXDUMP
 222   SHA-256: cde08b6a2cf5ad914f05203e18e3f7c2ed6060a63604e3d75536f19b55e8e0af
 223
 224 5.8 imdisk
 225   download http://www.ltr-data.se/files/imdiskinst.exe and extract it by 7zip.
 226
 227   INSTALL/ventoy/imdisk/64/imdisk.sys --> sys/amd64/imdisk.sys  SHA-256: 6702202220268787e361f5a82dae53362c8e6c6dcd240bb01b44dd77ae0788da
 228   INSTALL/ventoy/imdisk/64/imdisk.exe --> cli/amd64/imdisk.exe  SHA-256: 9759175380af836869443e5f21ce2e33022125d154bc6b3d1c04dc36b190de04
 229   INSTALL/ventoy/imdisk/64/imdisk.cpl --> cpl/amd64/imdisk.cpl  SHA-256: aea2ebbea2b073c947263744962af8a3eab025ff4c9d825c543e380e738a4c99
 230
 231   INSTALL/ventoy/imdisk/32/imdisk.sys --> sys/i386/imdisk.sys  SHA-256: a94caec2f71a924d6a914c093ad4b905d7cfdea3f515ed48aaa8c3950b2dc191
 232   INSTALL/ventoy/imdisk/32/imdisk.exe --> cli/i386/imdisk.exe  SHA-256: 33b53858e2139704cf603b115a3e5e1dfd4daeaaed4d3e03c633f2df3b55dbaa
 233   INSTALL/ventoy/imdisk/32/imdisk.cpl --> cpl/i386/imdisk.cpl  SHA-256: b781d3e2d286ac8bf548f44e50cbbb3fe78203296e41e4d2e73b407668f88f2d
 234
 235 5.9 INSTALL/ventoy/memdisk
 236   https://mirrors.edge.kernel.org/pub/linux/utils/boot/syslinux/syslinux-6.03.tar.gz
 237   decompress it and memdisk is at syslinux-6.03/bios/memdisk/memdisk
 238   SHA-256: 3f6cd656b8a14109cd3f906fee2dd2e75418f983a5e1bfdb64f44f7765588cbb
 239
 240
 241 5.10 UEFIinSecureBoot
 242  https://github.com/ValdikSS/Super-UEFIinSecureBoot-Disk/releases   Super-UEFIinSecureBoot-Disk_minimal_v3.zip
 243  unzip it and get Super-UEFIinSecureBoot-Disk_minimal.img, extract the img by 7zip.
 244
 245  INSTALL/EFI/BOOT/BOOTX64.EFI --> EFI/BOOT/BOOTX64.EFI  SHA-256: 475552c7476ad45e42344eee8b30d44c264d200ac2468428aa86fc8795fb6e34
 246  INSTALL/EFI/BOOT/grubx64.efi --> EFI/BOOT/grubx64.efi  SHA-256: 25d858157349dc52fa70f3cdf5c62fe1e0bae37ddfc3a6b6528af9a3c745775f
 247  INSTALL/EFI/BOOT/MokManager.efi --> EFI/BOOT/MokManager.efi  SHA-256: 3bf1f46cee0832355c7dd1dba880dea9bcaa78cc44375a1559d43bc9db18933b
 248
 249
 250 5.11 INSTALL/tool/ash
 251  https://busybox.net/downloads/binaries/1.31.0-i686-uclibc/   busybox_ASH
 252  SHA-256: 2943f02f85fee0c9551aec47110a558a73f919c032b3c51e56d6f197b5ec4d7b
 253
 254 5.12 7za.exe
 255  download from https://www.7-zip.org/a/7z1900-extra.7z
 256  ISNTALL/ventoy/7z/64/7za.exe  SHA-256: 8117e40ee7f824f63373a4f5625bb62749f69159d0c449b3ce2f35aad3b83549
 257  ISNTALL/ventoy/7z/32/7za.exe  SHA-256: ea308c76a2f927b160a143d94072b0dce232e04b751f0c6432a94e05164e716d
 258
 259
 260