123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323 |
- ===========================
- Livepatch module Elf format
- ===========================
- This document outlines the Elf format requirements that livepatch modules must follow.
- -----------------
- Table of Contents
- -----------------
- 0. Background and motivation
- 1. Livepatch modinfo field
- 2. Livepatch relocation sections
- 2.1 What are livepatch relocation sections?
- 2.2 Livepatch relocation section format
- 2.2.1 Required flags
- 2.2.2 Required name format
- 2.2.3 Example livepatch relocation section names
- 2.2.4 Example `readelf --sections` output
- 2.2.5 Example `readelf --relocs` output
- 3. Livepatch symbols
- 3.1 What are livepatch symbols?
- 3.2 A livepatch module's symbol table
- 3.3 Livepatch symbol format
- 3.3.1 Required flags
- 3.3.2 Required name format
- 3.3.3 Example livepatch symbol names
- 3.3.4 Example `readelf --symbols` output
- 4. Architecture-specific sections
- 5. Symbol table and Elf section access
- ----------------------------
- 0. Background and motivation
- ----------------------------
- Formerly, livepatch required separate architecture-specific code to write
- relocations. However, arch-specific code to write relocations already
- exists in the module loader, so this former approach produced redundant
- code. So, instead of duplicating code and re-implementing what the module
- loader can already do, livepatch leverages existing code in the module
- loader to perform the all the arch-specific relocation work. Specifically,
- livepatch reuses the apply_relocate_add() function in the module loader to
- write relocations. The patch module Elf format described in this document
- enables livepatch to be able to do this. The hope is that this will make
- livepatch more easily portable to other architectures and reduce the amount
- of arch-specific code required to port livepatch to a particular
- architecture.
- Since apply_relocate_add() requires access to a module's section header
- table, symbol table, and relocation section indices, Elf information is
- preserved for livepatch modules (see section 5). Livepatch manages its own
- relocation sections and symbols, which are described in this document. The
- Elf constants used to mark livepatch symbols and relocation sections were
- selected from OS-specific ranges according to the definitions from glibc.
- 0.1 Why does livepatch need to write its own relocations?
- ---------------------------------------------------------
- A typical livepatch module contains patched versions of functions that can
- reference non-exported global symbols and non-included local symbols.
- Relocations referencing these types of symbols cannot be left in as-is
- since the kernel module loader cannot resolve them and will therefore
- reject the livepatch module. Furthermore, we cannot apply relocations that
- affect modules not yet loaded at patch module load time (e.g. a patch to a
- driver that is not loaded). Formerly, livepatch solved this problem by
- embedding special "dynrela" (dynamic rela) sections in the resulting patch
- module Elf output. Using these dynrela sections, livepatch could resolve
- symbols while taking into account its scope and what module the symbol
- belongs to, and then manually apply the dynamic relocations. However this
- approach required livepatch to supply arch-specific code in order to write
- these relocations. In the new format, livepatch manages its own SHT_RELA
- relocation sections in place of dynrela sections, and the symbols that the
- relas reference are special livepatch symbols (see section 2 and 3). The
- arch-specific livepatch relocation code is replaced by a call to
- apply_relocate_add().
- ================================
- PATCH MODULE FORMAT REQUIREMENTS
- ================================
- --------------------------
- 1. Livepatch modinfo field
- --------------------------
- Livepatch modules are required to have the "livepatch" modinfo attribute.
- See the sample livepatch module in samples/livepatch/ for how this is done.
- Livepatch modules can be identified by users by using the 'modinfo' command
- and looking for the presence of the "livepatch" field. This field is also
- used by the kernel module loader to identify livepatch modules.
- Example modinfo output:
- -----------------------
- % modinfo livepatch-meminfo.ko
- filename: livepatch-meminfo.ko
- livepatch: Y
- license: GPL
- depends:
- vermagic: 4.3.0+ SMP mod_unload
- --------------------------------
- 2. Livepatch relocation sections
- --------------------------------
- -------------------------------------------
- 2.1 What are livepatch relocation sections?
- -------------------------------------------
- A livepatch module manages its own Elf relocation sections to apply
- relocations to modules as well as to the kernel (vmlinux) at the
- appropriate time. For example, if a patch module patches a driver that is
- not currently loaded, livepatch will apply the corresponding livepatch
- relocation section(s) to the driver once it loads.
- Each "object" (e.g. vmlinux, or a module) within a patch module may have
- multiple livepatch relocation sections associated with it (e.g. patches to
- multiple functions within the same object). There is a 1-1 correspondence
- between a livepatch relocation section and the target section (usually the
- text section of a function) to which the relocation(s) apply. It is
- also possible for a livepatch module to have no livepatch relocation
- sections, as in the case of the sample livepatch module (see
- samples/livepatch).
- Since Elf information is preserved for livepatch modules (see Section 5), a
- livepatch relocation section can be applied simply by passing in the
- appropriate section index to apply_relocate_add(), which then uses it to
- access the relocation section and apply the relocations.
- Every symbol referenced by a rela in a livepatch relocation section is a
- livepatch symbol. These must be resolved before livepatch can call
- apply_relocate_add(). See Section 3 for more information.
- ---------------------------------------
- 2.2 Livepatch relocation section format
- ---------------------------------------
- 2.2.1 Required flags
- --------------------
- Livepatch relocation sections must be marked with the SHF_RELA_LIVEPATCH
- section flag. See include/uapi/linux/elf.h for the definition. The module
- loader recognizes this flag and will avoid applying those relocation sections
- at patch module load time. These sections must also be marked with SHF_ALLOC,
- so that the module loader doesn't discard them on module load (i.e. they will
- be copied into memory along with the other SHF_ALLOC sections).
- 2.2.2 Required name format
- --------------------------
- The name of a livepatch relocation section must conform to the following format:
- .klp.rela.objname.section_name
- ^ ^^ ^ ^ ^
- |________||_____| |__________|
- [A] [B] [C]
- [A] The relocation section name is prefixed with the string ".klp.rela."
- [B] The name of the object (i.e. "vmlinux" or name of module) to
- which the relocation section belongs follows immediately after the prefix.
- [C] The actual name of the section to which this relocation section applies.
- 2.2.3 Example livepatch relocation section names:
- -------------------------------------------------
- .klp.rela.ext4.text.ext4_attr_store
- .klp.rela.vmlinux.text.cmdline_proc_show
- 2.2.4 Example `readelf --sections` output for a patch
- module that patches vmlinux and modules 9p, btrfs, ext4:
- --------------------------------------------------------
- Section Headers:
- [Nr] Name Type Address Off Size ES Flg Lk Inf Al
- [ snip ]
- [29] .klp.rela.9p.text.caches.show RELA 0000000000000000 002d58 0000c0 18 AIo 64 9 8
- [30] .klp.rela.btrfs.text.btrfs.feature.attr.show RELA 0000000000000000 002e18 000060 18 AIo 64 11 8
- [ snip ]
- [34] .klp.rela.ext4.text.ext4.attr.store RELA 0000000000000000 002fd8 0000d8 18 AIo 64 13 8
- [35] .klp.rela.ext4.text.ext4.attr.show RELA 0000000000000000 0030b0 000150 18 AIo 64 15 8
- [36] .klp.rela.vmlinux.text.cmdline.proc.show RELA 0000000000000000 003200 000018 18 AIo 64 17 8
- [37] .klp.rela.vmlinux.text.meminfo.proc.show RELA 0000000000000000 003218 0000f0 18 AIo 64 19 8
- [ snip ] ^ ^
- | |
- [*] [*]
- [*] Livepatch relocation sections are SHT_RELA sections but with a few special
- characteristics. Notice that they are marked SHF_ALLOC ("A") so that they will
- not be discarded when the module is loaded into memory, as well as with the
- SHF_RELA_LIVEPATCH flag ("o" - for OS-specific).
- 2.2.5 Example `readelf --relocs` output for a patch module:
- -----------------------------------------------------------
- Relocation section '.klp.rela.btrfs.text.btrfs_feature_attr_show' at offset 0x2ba0 contains 4 entries:
- Offset Info Type Symbol's Value Symbol's Name + Addend
- 000000000000001f 0000005e00000002 R_X86_64_PC32 0000000000000000 .klp.sym.vmlinux.printk,0 - 4
- 0000000000000028 0000003d0000000b R_X86_64_32S 0000000000000000 .klp.sym.btrfs.btrfs_ktype,0 + 0
- 0000000000000036 0000003b00000002 R_X86_64_PC32 0000000000000000 .klp.sym.btrfs.can_modify_feature.isra.3,0 - 4
- 000000000000004c 0000004900000002 R_X86_64_PC32 0000000000000000 .klp.sym.vmlinux.snprintf,0 - 4
- [ snip ] ^
- |
- [*]
- [*] Every symbol referenced by a relocation is a livepatch symbol.
- --------------------
- 3. Livepatch symbols
- --------------------
- -------------------------------
- 3.1 What are livepatch symbols?
- -------------------------------
- Livepatch symbols are symbols referred to by livepatch relocation sections.
- These are symbols accessed from new versions of functions for patched
- objects, whose addresses cannot be resolved by the module loader (because
- they are local or unexported global syms). Since the module loader only
- resolves exported syms, and not every symbol referenced by the new patched
- functions is exported, livepatch symbols were introduced. They are used
- also in cases where we cannot immediately know the address of a symbol when
- a patch module loads. For example, this is the case when livepatch patches
- a module that is not loaded yet. In this case, the relevant livepatch
- symbols are resolved simply when the target module loads. In any case, for
- any livepatch relocation section, all livepatch symbols referenced by that
- section must be resolved before livepatch can call apply_relocate_add() for
- that reloc section.
- Livepatch symbols must be marked with SHN_LIVEPATCH so that the module
- loader can identify and ignore them. Livepatch modules keep these symbols
- in their symbol tables, and the symbol table is made accessible through
- module->symtab.
- -------------------------------------
- 3.2 A livepatch module's symbol table
- -------------------------------------
- Normally, a stripped down copy of a module's symbol table (containing only
- "core" symbols) is made available through module->symtab (See layout_symtab()
- in kernel/module.c). For livepatch modules, the symbol table copied into memory
- on module load must be exactly the same as the symbol table produced when the
- patch module was compiled. This is because the relocations in each livepatch
- relocation section refer to their respective symbols with their symbol indices,
- and the original symbol indices (and thus the symtab ordering) must be
- preserved in order for apply_relocate_add() to find the right symbol.
- For example, take this particular rela from a livepatch module:
- Relocation section '.klp.rela.btrfs.text.btrfs_feature_attr_show' at offset 0x2ba0 contains 4 entries:
- Offset Info Type Symbol's Value Symbol's Name + Addend
- 000000000000001f 0000005e00000002 R_X86_64_PC32 0000000000000000 .klp.sym.vmlinux.printk,0 - 4
- This rela refers to the symbol '.klp.sym.vmlinux.printk,0', and the symbol index is encoded
- in 'Info'. Here its symbol index is 0x5e, which is 94 in decimal, which refers to the
- symbol index 94.
- And in this patch module's corresponding symbol table, symbol index 94 refers to that very symbol:
- [ snip ]
- 94: 0000000000000000 0 NOTYPE GLOBAL DEFAULT OS [0xff20] .klp.sym.vmlinux.printk,0
- [ snip ]
- ---------------------------
- 3.3 Livepatch symbol format
- ---------------------------
- 3.3.1 Required flags
- --------------------
- Livepatch symbols must have their section index marked as SHN_LIVEPATCH, so
- that the module loader can identify them and not attempt to resolve them.
- See include/uapi/linux/elf.h for the actual definitions.
- 3.3.2 Required name format
- --------------------------
- Livepatch symbol names must conform to the following format:
- .klp.sym.objname.symbol_name,sympos
- ^ ^^ ^ ^ ^ ^
- |_______||_____| |_________| |
- [A] [B] [C] [D]
- [A] The symbol name is prefixed with the string ".klp.sym."
- [B] The name of the object (i.e. "vmlinux" or name of module) to
- which the symbol belongs follows immediately after the prefix.
- [C] The actual name of the symbol.
- [D] The position of the symbol in the object (as according to kallsyms)
- This is used to differentiate duplicate symbols within the same
- object. The symbol position is expressed numerically (0, 1, 2...).
- The symbol position of a unique symbol is 0.
- 3.3.3 Example livepatch symbol names:
- -------------------------------------
- .klp.sym.vmlinux.snprintf,0
- .klp.sym.vmlinux.printk,0
- .klp.sym.btrfs.btrfs_ktype,0
- 3.3.4 Example `readelf --symbols` output for a patch module:
- ------------------------------------------------------------
- Symbol table '.symtab' contains 127 entries:
- Num: Value Size Type Bind Vis Ndx Name
- [ snip ]
- 73: 0000000000000000 0 NOTYPE GLOBAL DEFAULT OS [0xff20] .klp.sym.vmlinux.snprintf,0
- 74: 0000000000000000 0 NOTYPE GLOBAL DEFAULT OS [0xff20] .klp.sym.vmlinux.capable,0
- 75: 0000000000000000 0 NOTYPE GLOBAL DEFAULT OS [0xff20] .klp.sym.vmlinux.find_next_bit,0
- 76: 0000000000000000 0 NOTYPE GLOBAL DEFAULT OS [0xff20] .klp.sym.vmlinux.si_swapinfo,0
- [ snip ] ^
- |
- [*]
- [*] Note that the 'Ndx' (Section index) for these symbols is SHN_LIVEPATCH (0xff20).
- "OS" means OS-specific.
- ---------------------------------
- 4. Architecture-specific sections
- ---------------------------------
- Architectures may override arch_klp_init_object_loaded() to perform
- additional arch-specific tasks when a target module loads, such as applying
- arch-specific sections. On x86 for example, we must apply per-object
- .altinstructions and .parainstructions sections when a target module loads.
- These sections must be prefixed with ".klp.arch.$objname." so that they can
- be easily identified when iterating through a patch module's Elf sections
- (See arch/x86/kernel/livepatch.c for a complete example).
- --------------------------------------
- 5. Symbol table and Elf section access
- --------------------------------------
- A livepatch module's symbol table is accessible through module->symtab.
- Since apply_relocate_add() requires access to a module's section headers,
- symbol table, and relocation section indices, Elf information is preserved for
- livepatch modules and is made accessible by the module loader through
- module->klp_info, which is a klp_modinfo struct. When a livepatch module loads,
- this struct is filled in by the module loader. Its fields are documented below:
- struct klp_modinfo {
- Elf_Ehdr hdr; /* Elf header */
- Elf_Shdr *sechdrs; /* Section header table */
- char *secstrings; /* String table for the section headers */
- unsigned int symndx; /* The symbol table section index */
- };
|