roadmap.html 68 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394959697989910010110210310410510610710810911011111211311411511611711811912012112212312412512612712812913013113213313413513613713813914014114214314414514614714814915015115215315415515615715815916016116216316416516616716816917017117217317417517617717817918018118218318418518618718818919019119219319419519619719819920020120220320420520620720820921021121221321421521621721821922022122222322422522622722822923023123223323423523623723823924024124224324424524624724824925025125225325425525625725825926026126226326426526626726826927027127227327427527627727827928028128228328428528628728828929029129229329429529629729829930030130230330430530630730830931031131231331431531631731831932032132232332432532632732832933033133233333433533633733833934034134234334434534634734834935035135235335435535635735835936036136236336436536636736836937037137237337437537637737837938038138238338438538638738838939039139239339439539639739839940040140240340440540640740840941041141241341441541641741841942042142242342442542642742842943043143243343443543643743843944044144244344444544644744844945045145245345445545645745845946046146246346446546646746846947047147247347447547647747847948048148248348448548648748848949049149249349449549649749849950050150250350450550650750850951051151251351451551651751851952052152252352452552652752852953053153253353453553653753853954054154254354454554654754854955055155255355455555655755855956056156256356456556656756856957057157257357457557657757857958058158258358458558658758858959059159259359459559659759859960060160260360460560660760860961061161261361461561661761861962062162262362462562662762862963063163263363463563663763863964064164264364464564664764864965065165265365465565665765865966066166266366466566666766866967067167267367467567667767867968068168268368468568668768868969069169269369469569669769869970070170270370470570670770870971071171271371471571671771871972072172272372472572672772872973073173273373473573673773873974074174274374474574674774874975075175275375475575675775875976076176276376476576676776876977077177277377477577677777877978078178278378478578678778878979079179279379479579679779879980080180280380480580680780880981081181281381481581681781881982082182282382482582682782882983083183283383483583683783883984084184284384484584684784884985085185285385485585685785885986086186286386486586686786886987087187287387487587687787887988088188288388488588688788888989089189289389489589689789889990090190290390490590690790890991091191291391491591691791891992092192292392492592692792892993093193293393493593693793893994094194294394494594694794894995095195295395495595695795895996096196296396496596696796896997097197297397497597697797897998098198298398498598698798898999099199299399499599699799899910001001100210031004100510061007100810091010101110121013101410151016101710181019102010211022102310241025102610271028102910301031103210331034103510361037103810391040104110421043104410451046104710481049105010511052105310541055105610571058105910601061106210631064106510661067106810691070107110721073107410751076107710781079108010811082108310841085108610871088108910901091109210931094109510961097109810991100110111021103110411051106110711081109111011111112111311141115111611171118111911201121112211231124112511261127112811291130113111321133113411351136113711381139114011411142114311441145114611471148114911501151115211531154115511561157115811591160116111621163116411651166116711681169117011711172117311741175117611771178117911801181118211831184118511861187118811891190119111921193119411951196119711981199120012011202120312041205120612071208120912101211121212131214121512161217121812191220122112221223122412251226122712281229123012311232123312341235123612371238123912401241124212431244124512461247124812491250125112521253125412551256125712581259126012611262126312641265126612671268126912701271127212731274127512761277127812791280128112821283128412851286128712881289129012911292129312941295129612971298129913001301130213031304130513061307130813091310131113121313131413151316131713181319132013211322132313241325132613271328132913301331133213331334133513361337133813391340134113421343134413451346134713481349135013511352135313541355135613571358135913601361136213631364136513661367136813691370137113721373137413751376137713781379138013811382138313841385138613871388138913901391139213931394139513961397139813991400140114021403140414051406140714081409141014111412141314141415141614171418141914201421142214231424142514261427142814291430143114321433143414351436143714381439144014411442144314441445144614471448144914501451
  1. <html><head><title>toybox roadmap</title>
  2. <!--#include file="header.html" -->
  3. <title>Toybox Roadmap</title>
  4. <h2>Roadmap sections</h2>
  5. <ul>
  6. <li><a href=#goals>Introduction</a></li>
  7. <li><a href=#susv4>POSIX-2008/SUSv4</a></li>
  8. <li><a href=#sigh>Linux "Standard" Base</a></li>
  9. <li><a href=#rfc>IETF RFCs and Man Pages</a></li>
  10. <li><a href=#dev_env>Development Environment</a></li>
  11. <li><a href=#android>Android Toolbox</a></li>
  12. <li><a href=#aosp>Building AOSP</a></li>
  13. <li><a href=#tizen>Tizen Core</a></li>
  14. <li><a href=#yocto>Yocto</a></li>
  15. <li><a href=#fhs>Filesystem Hierachy Standard</a></li>
  16. <li><a href=#buildroot>buildroot</a></li>
  17. <li>Miscelaneous: <a href=#klibc>klibc</a>, <a href=#glibc>glibc</a>,
  18. <a href=#sash>sash</a>, <a href=#sbase>sbase</a>,
  19. <a href=#uclinux>uclinux</a>...</li>
  20. <li><a href=#packages>Other Packages</a></li>
  21. </ul>
  22. <a name="goals" />
  23. <h2>Introduction (Goals and use cases)</h2>
  24. <p>We have several potential use cases for a new set of command line
  25. utilities, and are using those to determine which commands to implement
  26. for Toybox's 1.0 release. Most of these have their own section in the
  27. <a href=status.html>status page</a>, showing current progress towards
  28. commplation.</p>
  29. <p>The most interesting publicly available standards are A) POSIX-2008 (also
  30. known as SUSv4), B) the Linux Standard Base version 4.1, and C) the official
  31. <a href=https://www.kernel.org/doc/man-pages/>Linux man pages</a>.
  32. But they include commands we've decided not implement, exclude
  33. commands or features we have, and don't always entirely match reality.</p>
  34. <p>The most thorough real world test (other than a large interactive
  35. userbase) is using toybox as the command line in a build system such as
  36. <a href=https://landley.net/aboriginal/about.html>Aboriginal
  37. Linux</a>, having it rebuild itself from source code, and using the result
  38. to <a href=https://github.com/landley/control-images>build Linux From Scratch</a>.
  39. The current "minimal native development system" goal is to use
  40. <a href=faq.html#mkroot>mkroot</a>
  41. plus <a href=faq.html#cross>musl-cross-make</a> to hermetically build
  42. <a href=https://source.android.com>AOSP</a>.</p>
  43. <p>We've also checked what commands were provided by similar projects
  44. (klibc, sash, sbase, embutils,
  45. nash, and beastiebox), looked at various vendor configurations of busybox,
  46. and collected end user requests.</p>
  47. <p>Finally, we'd like to provide a good replacement for the Bash shell,
  48. which was the first program Linux ever ran and remains the standard shell
  49. of Linux (no matter what Ubuntu says). This doesn't necessarily mean including
  50. every last Bash 5.x feature, but does involve {various,features} &lt(beyond)
  51. posix.</p>
  52. <p>See the <a href=status.html>status page</a> for the categorized command list
  53. and progress towards implementing it. There's also a
  54. <a href=todo.html>historical todo list</a> from the project's 2011 relaunch.</p>
  55. <hr />
  56. <a name="standards">
  57. <h2>Use case: standards compliance.</h2>
  58. <h3><a name=susv4 /><a href="#susv4">POSIX-2008/SUSv4</a></h3>
  59. <p>The best standards describe reality rather than attempting to impose a
  60. new one. A good standard should document, not legislate.
  61. Standards which document existing reality tend to be approved by
  62. more than one standards body, such ANSI and ISO both approving <a href=https://landley.net/c99-draft.html>C99</a>. That's why IEEE 1003.1-2008,
  63. the Single Unix Specification version 4, and the Open Group Base Specification
  64. edition 7 are all the same standard from three sources, but most people just
  65. call it "posix" (portable operating system derived from unix).
  66. It's available <a href=https://pubs.opengroup.org/onlinepubs/9699919799>online in full</a>, and may be downloaded as a tarball.
  67. Previous versions (<a href=https://pubs.opengroup.org/onlinepubs/009695399/>SUSv3</a> and
  68. <a href=https://pubs.opengroup.org/onlinepubs/7990989775/>SUSv2</a>)
  69. are also available.
  70. (Note:
  71. <a href=https://pubs.opengroup.org/onlinepubs/9699919799.2008edition/>Posix
  72. 2008</a> was reissued in 2013 and 2018, the first was minor wordsmithing
  73. with no behavioral changes, the second was to renew a ten year timeout
  74. to still be considered a "current standard" by some government regulations.
  75. It's still posix-2008/SUSv4/issue 7.)</p>
  76. <h3>Why not just use posix for everything?</h3>
  77. <p>Unfortunately, Posix describes an incomplete subset of reality, because
  78. it was designed to. It started with proprietary unix vendors collaborating to
  79. describe the functionality their fragmented APIs could agree on, which was then
  80. incorporated into <a href=https://nvlpubs.nist.gov/nistpubs/Legacy/FIPS/fipspub151-2-1993.pdf>US federal procurement standards</a>
  81. as a <a href=https://www.youtube.com/watch?v=nwrTTXOg-KI>compliance requirement</a>
  82. for things like navy contracts, giving large corporations
  83. like IBM and Microsoft millions of dollars of incentive
  84. to punch holes in the standard big enough to drive
  85. <a href=https://en.wikipedia.org/wiki/Microsoft_POSIX_subsystem>Windows NT</a> and
  86. <a href=http://www.naspa.net/magazine/1996/May/T9605006.PDF>OS/360</a> through.
  87. When open source projects like Linux started developing on the internet
  88. (enabled by the 1993 relaxation of the National Science Foundation's
  89. "Acceptable Use Policy" allowing everyone to connect to the internet,
  90. previously restricted to approved government/military/university organizations),
  91. Posix <a href=http://www.opengroup.org/testing/fips/policy_info.html>ignored
  92. the upstarts</a> and Linux eventually
  93. <a href=https://www.linuxjournal.com/article/3417>returned the favor</a>,
  94. leaving Posix behind.</p>
  95. <p>The result is a "standard" that lacks any mention of commands like
  96. "init" or "mount" required to actually boot a system.
  97. It describes logname but not login. It provides ipcrm
  98. and ipcs, but not ipcmk, so you can use System V IPC resources but not create
  99. them. And widely used real-world commands such as tar and cpio (the basis
  100. of initramfs and RPM) which were present in earlier
  101. versions of the standard have been removed, while obsolete commands like
  102. cksum, compress, sccs and uucp remain with no mention of modern counterparts
  103. like crc32/sha1sum, gzip/xz, svn/git or scp/rsync. Meanwhile posix' description
  104. of the commands
  105. themselves are missing dozens of features and specify silly things like ebcdic
  106. support in dd or that wc should use %d (not %lld) for byte counts. So
  107. we have to extensively filter posix to get a useful set of recommendations.</p>
  108. <h3>Analysis</h3>
  109. <p>Starting with the
  110. <a href="http://pubs.opengroup.org/onlinepubs/9699919799.2008edition/idx/utilities.html">full "utilities" list</a>,
  111. we first remove generally obsolete
  112. commands (compress ed ex pr uncompress uccp uustat uux), commands for the
  113. pre-CVS "SCCS" source control system (admin delta get prs rmdel sact sccs unget
  114. val what), fortran support (asa fort77), and batch processing support (batch
  115. qalter qdel qhold qmove qmsg qrerun qrls qselect qsig qstat qsub).</p>
  116. <p>Some commands are for a compiler toolchain (ar c99 cflow ctags cxref gencat
  117. iconv lex m4 make nm strings strip tsort yacc) which is out of scope for
  118. toybox and should be supplied externally. (Some of these might be
  119. revisited later, but not for toybox 1.0.)</p>
  120. <p>Some commands are part of a command shell, and can't be implemented as
  121. separate executables (alias bg cd command fc fg getopts hash jobs kill read
  122. type ulimit umask unalias wait). These may be implemented as part of the
  123. built-in toybox shell, but are not exported into $PATH via symlinks and
  124. thus are not part of toybox's main command list. (If you fork a
  125. child process and have it "cd" then exit, you've accomplished nothing.)
  126. Again, what posix provides is incomplete: a shell also needs exit, if, while,
  127. for, case, export, set, unset, trap, exec... (And for bash compatibility
  128. function, source, declare...)</p>
  129. <p>A few other commands are judgement calls, providing command-line
  130. internationalization support (iconv locale localedef), System V inter-process
  131. communication (ipcrm ipcs), and cross-tty communication from the minicomputer
  132. days (talk mesg write). The "pax" utility <a href=https://slashdot.org/story/06/09/04/1335226/debian-kicks-jrg-schilling>failed</a> to replace tar,
  133. "mailx" is
  134. a command line email client, and "lp" submits files for printing to... what
  135. exactly? (cups?) The standard defines crontab but not crond. What is
  136. pathchk supposed to be portable _to_? (Linux accepts 255 byte path components
  137. with any char except NUL or / and no max length on the total path, and
  138. <a href=https://yarchive.net/comp/linux/utf8.html>EXPLICITLY</a>
  139. doesn't care if it's an invalid utf8 sequence.)</p>
  140. <p>Removing all of that leaves the following commands, which toybox should
  141. implement:</p>
  142. <blockquote><b>
  143. <span id=posix>
  144. at awk basename bc cal cat chgrp chmod chown cksum cmp comm cp
  145. csplit cut date dd df diff dirname du echo env expand expr false file find
  146. fold fuser getconf grep head id join kill link ln logger logname ls man
  147. mkdir mkfifo more mv newgrp nice nl nohup od paste patch printf ps
  148. pwd renice rm rmdir sed sh sleep sort split stty tabs tail tee test time
  149. touch tput tr true tty uname unexpand uniq unlink uudecode uuencode vi wc
  150. who xargs zcat
  151. </span>
  152. </b></blockquote>
  153. <h3><a name=sigh /><a href="#sigh">Linux Standard Base</a></h3>
  154. <p>One attempt to supplement POSIX towards an actual usable system was the
  155. Linux Standard Base. Unfortunately, the quality of this "standard" is
  156. fairly low, largely due to the Free Standards Group that maintained it
  157. being consumed by <a href=https://landley.net/notes-2010.html#18-07-2010>the Linux Foundation</a> in 2007.</p>
  158. <p>Where POSIX allowed its standards process to be compromised
  159. by leaving things out (but what
  160. they DID standardize tends to be respected, if sometimes obsolete),
  161. the Linux Standard Base's failure mode is different. They respond to
  162. pressure by including anything their members pay them enough to promote,
  163. such as allowing Red Hat to push
  164. RPM into the standard even though all sorts of distros (Debian, Slackware, Arch,
  165. Gentoo, Android) don't use it and never will. This means anything in the LSB is
  166. at best a suggestion: arbitrary portions of this standard are widely
  167. ignored.</p>
  168. <p>The <a href=https://mjg59.dreamwidth.org/39546.html>community perception</a>
  169. seems to be that the Linux Standard Base is
  170. the best standard money can buy: the Linux Foundation is supported by
  171. financial donations from large companies and the LSB
  172. <a href=https://www.softwarefreedom.org/blog/2016/apr/11/lf/>represents the interests
  173. of those donors</a> regardless of technical merit. (The Linux Foundation, which
  174. maintains the LSB, is NOT a 501c3. It's a 501c6, the
  175. same kind of legal entity as the Tobacco Institute and
  176. <a href=https://lwn.net/Articles/706585/>Microsoft's</a>
  177. old "<a href=https://en.wikipedia.org/wiki/Don%27t_Copy_That_Floppy>Don't Copy That Floppy</a>" program.) Debian officially
  178. <a href=http://lwn.net/Articles/658809>washed its hands of LSB</a> by
  179. refusing to adopt release 5.0 in 2015, and no longer even pretends to support
  180. it (which affects Debian derivatives like Ubuntu and Knoppix). Toybox has
  181. stayed on 4.1 for similar reasons: a lot of historical effort went into
  182. producing the standard before the Linux Foundation took over.</p>
  183. <p>That said, Posix by itself isn't enough, and this is the next most
  184. comprehensive standards effort for Linux so far, so we salvage what we can.</p>
  185. <h3>Analysis</h3>
  186. <p>The LSB specifies a <a href=http://refspecs.linuxfoundation.org/LSB_4.1.0/LSB-Core-generic/LSB-Core-generic/cmdbehav.html>list of command line
  187. utilities</a>:</p>
  188. <blockquote><b>
  189. ar at awk batch bc chfn chsh col cpio crontab df dmesg du echo egrep
  190. fgrep file fuser gettext grep groupadd groupdel groupmod groups
  191. gunzip gzip hostname install install_initd ipcrm ipcs killall lpr ls
  192. lsb_release m4 md5sum mknod mktemp more mount msgfmt newgrp od passwd
  193. patch pidof remove_initd renice sed sendmail seq sh shutdown su sync
  194. tar umount useradd userdel usermod xargs zcat
  195. </b></blockquote>
  196. <p>Where posix specifies one of those commands, LSB's deltas tend to be
  197. accomodations for broken tool versions which aren't up to date with the
  198. standard yet. (See <a href=http://refspecs.linuxfoundation.org/LSB_4.1.0/LSB-Core-generic/LSB-Core-generic/more.html>more</a> and <a href=http://refspecs.linuxfoundation.org/LSB_4.1.0/LSB-Core-generic/LSB-Core-generic/xargs.html>xargs</a>
  199. for examples.)</p>
  200. <p>Since we've already committed to using our own judgement to skip bits of
  201. POSIX, and LSB's "judgement" in this regard is purely bug workarounds to declare
  202. various legacy tool implementations "compliant", this means we're mostly
  203. interested in the set of LSB tools that aren't mentioned in posix.</p>
  204. <p>Of these, gettext and msgfmt are internationalization, install_initd and
  205. remove_initd weren't present in Ubuntu 10.04, lpr is out of scope,
  206. lsb_release just reports information in /etc/os-release, and sendmail's
  207. turned into a pile of cryptographic verification and DNS shenanigans due
  208. to spammers.</p>
  209. <p>This leaves:</p>
  210. <blockquote><b>
  211. <span id=lsb>
  212. chfn chsh dmesg egrep fgrep groupadd groupdel groupmod groups
  213. gunzip gzip hostname install killall md5sum
  214. mknod mktemp mount passwd pidof seq shutdown
  215. su sync tar umount useradd userdel usermod zcat
  216. </span>
  217. </b></blockquote>
  218. <h3><a name=rfc /><a href="#rfc">IETF RFCs and Man Pages</a></h3>
  219. <p>They're very nice, but there's thousands of them.</p>
  220. <p>Discussion of standards wouldn't be complete without the Internet
  221. Engineering Task Force's "<a href=https://www.rfc-editor.org/in-notes/rfc-index.txt>Request For Comments</a>" collection and Michael Kerrisk's
  222. <a href=https://www.kernel.org/doc/man-pages/>Linux man-pages project</a>.
  223. Except these aren't standards, they're collections of documentation with
  224. low barriers to inclusion. They're not saying "you should support
  225. X", they're saying "if you do, here's how".
  226. Thus neither really helps us select which commands to include.</p>
  227. <p>The man pages website includes the commands in git, yum, perf, postgres,
  228. flatpack... Great for examining the features of a command you've
  229. already decided to include, useless for deciding _what_ to include.</p>
  230. <p>The RFCs are more about protocols than commands. The noise level is
  231. extremely high: there's thousands of RFCs, many describing a proposed idea
  232. that never took off, and less than 1% of the resulting documents are
  233. currently relevant to toybox. The documents are numbered based on the
  234. order they were received, with no real attempt at coherently indexing
  235. the result. As with man pages they can be <a href=https://www.ietf.org/rfc/rfc0610.txt>long and complicated</a> or
  236. <a href=https://www.ietf.org/rfc/rfc1951.txt>terse and impenetrable</a>,
  237. have developed a certain amount of <a href=https://www.ietf.org/rfc/rfc8179.txt>bureaucracy</a> over the years, and often the easiest way to understand what
  238. they <a href=https://www.ietf.org/rfc/rfc4330.txt>document</a> is to find an <a href=https://www.ietf.org/rfc/rfc1769.txt>earlier version</a> to read first.
  239. (The greybeard community problem where all documentation is written by people
  240. who don't remember NOT already knowing this stuff.)</p>
  241. <p>That said, RFC documents can be useful (especially for networking protocols)
  242. and the four URL templates the recommended starting files
  243. for new commands (toys/example/{skeleton,hello}.c) provide point to posix, lsb,
  244. man, and rfc pages.</p>
  245. <hr />
  246. <a name="dev_env">
  247. <h2><a href="#dev_env">Use case: provide a self-hosting development environment</a></h2>
  248. <p>Once upon a time, the following commands were enough to build the <a href=http://landley.net/aboriginal/about.html>Aboriginal Linux</a> development
  249. environment, boot it to a shell prompt, and build <a href=http://www.linuxfromscratch.org/lfs/view/6.8/>Linux From Scratch 6.8</a> under it.</p>
  250. <blockquote><b>
  251. <span id=development>
  252. bzcat cat cp dirname echo env patch rmdir sha1sum sleep sort sync
  253. true uname wc which yes zcat
  254. awk basename chmod chown cmp cut date dd diff
  255. egrep expr fdisk find grep gzip head hostname id install ln ls
  256. mkdir mktemp mv od readlink rm sed sh tail tar touch tr uniq
  257. wget whoami xargs chgrp comm gunzip less logname split
  258. tee test time bunzip2 chgrp chroot comm cpio dmesg
  259. dnsdomainname ftpget ftpput gunzip ifconfig init less
  260. logname losetup mdev mount mountpoint nc pgrep pkill
  261. pwd route split stat switch_root tac umount vi
  262. resize2fs tune2fs fsck.ext2 genext2fs mke2fs xzcat
  263. </span>
  264. </b></blockquote>
  265. <p>This use case includes running init scripts and other shell scripts, running
  266. configure, make, and install in each package, and providing basic command line
  267. facilities such as a text editor. (It does not include a compiler toolchain or
  268. C library, those are outside the scope of the toybox project, although mkroot
  269. has a <a href=https://landley.net/code/qcc>potentialy follow-up project</a>.
  270. For now we use distro toolchains,
  271. <a href=https://github.com/richfelker/musl-cross-make>musl-cross-make</a>,
  272. and the Android NDK for build testing.)
  273. That build system also instaled bash 2.05b as #!/bin/sh and its scripts
  274. required bash extensions not present in shells such as busybox ash.
  275. To replace that toysh needs to supply several bash extensions _and_ work
  276. when called under the name "bash".</p>
  277. <p>The above command list was collected using a command line recording wrapper
  278. (scripts/record-commands and toys/example/logpath.c) which scripts/mkroot.sh
  279. also uses to populate root/log/*-commands.txt. Try
  280. <b>awk '{print $1}' root/build/log/*-commands.txt | sort -u | grep -v musl | xargs</b>
  281. after building a mkroot target to see the list of commands called out
  282. of the $PATH during that build.</p>
  283. <h3>Stages and moving targets</h3>
  284. <p>The development environment use case has two stages, achieving:
  285. 1) a bootable system that can rebuild itself from source, and 2)
  286. a build environment capable
  287. of bootstrapping up to arbitrary complexity (by building
  288. Linux From Scratch and Beyond Linux From Scratch under the resulting
  289. system, or the Android Open Source Project). To accomplish just the first
  290. goal (a minimal system that can rebuild _itself_ from source), the old
  291. build still needs the following busybox commands for which toybox does
  292. not yet supply adequate replacements:</p>
  293. <blockquote><b>
  294. awk dd diff expr fdisk gzip less route sh tr unxz vi xzcat
  295. </b></blockquote>
  296. <p>All of those except awk and less have partial implementations
  297. in "pending".</p>
  298. <p>In 2017 Aboriginal Linux development ended, replaced by a much simpler
  299. project ("mkroot") designed to use an existing cross+native toolchain (such as
  300. <a href=https://github.com/richfelker/musl-cross-make>musl-cross-make</a>
  301. or the Android NDK) instead of building its own cross and native compilers
  302. from source. In 2019 the still-incomplete
  303. mkroot was merged into toybox as the "make root" target (which runs
  304. scripts/mkroot.sh). This is intended
  305. as a simpler way of providing essentially the same build environment, and doesn't
  306. significantly affect the rest of this analysis (although the "rebuild itself
  307. from source" test should now include building musl-cross-make under either
  308. mkroot or toybox's "make airlock" host environment).</p>
  309. <p>Building Linux From Scratch is not the same as building the
  310. <a href=https://source.android.com>Android Open Source Project</a>,
  311. but after toybox 1.0 we plan to try
  312. <a href=http://landley.net/aboriginal/about.html#hairball>modifying the AOSP build</a>
  313. to reduce dependencies. (It's fairly likely we'll have to add at least
  314. a read-only git utility so repo can download the build's source code,
  315. but that's actually <a href=https://www.youtube.com/watch?v=I-lGyn3PHP4>not
  316. that hard</a>. We'll probably also need our own "make" at some point after
  317. 1.0, which is its own moving target thanks to cmake and ninja and so on.)
  318. The ongoing Android <a href=http://lists.landley.net/pipermail/toybox-landley.net/2018-January/009330.html>hermetic build</a> work is already advancing
  319. this goal.</p>
  320. <hr />
  321. <h2><a name=android /><a href="#android">Use case: Replacing Android Toolbox</a></h2>
  322. <p>Android has a policy against GPL in userspace, so even though BusyBox
  323. predates Android by many years, they couldn't use it. Instead they grabbed
  324. an old version of ash (later replaced by
  325. <a href="https://www.mirbsd.org/mksh.htm">mksh</a>)
  326. and implemented their own command line utility set
  327. called "toolbox" (which toybox has already mostly replaced).</p>
  328. <p>Toolbox doesn't have its own repository, instead it's part of Android's
  329. <a href=https://android.googlesource.com/platform/system/core>system/core
  330. git repository</a>. Android's Native Development Kit (their standalone
  331. downloadable toolchain) has its own
  332. <a href=https://android.googlesource.com/platform/ndk/+/master/docs/Roadmap.md>roadmap</a>, and each version has
  333. <a href=https://developer.android.com/ndk/downloads/revision_history>release
  334. notes</a>.</p>
  335. <h3>Toolbox commands:</h3>
  336. <p>According to <a href=https://android.googlesource.com/platform/system/core/+/master/toolbox/Android.bp>
  337. system/core/toolbox/Android.bp</a> the toolbox directory builds the
  338. following commands:</p>
  339. <blockquote><b>
  340. getevent getprop modprobe setprop start
  341. </b></blockquote>
  342. <p>getprop/setprop/start were in toybox and moved back because they're so
  343. tied to non-public system interfaces. modprobe shares the implementation
  344. used in init. getevent is a board bringup tool built with a python script
  345. that pulls all the constants from the latest kernel headers.</p>
  346. <h3>Other Android /system/bin commands</h3>
  347. <p>Other than the toolbox links, the currently interesting
  348. binaries in /system/bin are:</p>
  349. <ul>
  350. <li><b>arping</b> - ARP REQUEST tool (iputils)</li>
  351. <li><b>blkid</b> - identify block devices (e2fsprogs)</li>
  352. <li><b>e2fsck</b> - fsck for ext2/ext3/ext4 (e2fsprogs)</li>
  353. <li><b>fsck.f2fs</b> - fsck for f2fs (f2fs-tools)</li>
  354. <li><b>fsck_msdos</b> - fsck for FAT (BSD)</li>
  355. <li><b>gzip</b> - compression/decompression tool (zlib)</li>
  356. <li><b>ip</b> - network routing tool (iproute2)</li>
  357. <li><b>iptables/ip6tables</b> - IPv4/IPv6 NAT admin (iptables)</li>
  358. <li><b>iw</b> - wireless device config tool (iw)</li>
  359. <li><b>logwrapper</b> - redirect stdio to android log (Android)</li>
  360. <li><b>make_ext4fs</b> - make ext4 fs (Android)</li>
  361. <li><b>make_f2fs</b> - make f2fs fs (f2fs-tools)</li>
  362. <li><b>ping/ping6</b> - ICMP ECHO_REQUEST tool (iputils)</li>
  363. <li><b>reboot</b> - reboot (Android)</li>
  364. <li><b>resize2fs</b> - resize ext2/ext3/ext4 fs (e2fsprogs)</li>
  365. <li><b>sh</b> - mksh (BSD)</li>
  366. <li><b>ss</b> - socket statistics (iproute2)</li>
  367. <li><b>tc</b> - traffic control (iproute2)</li>
  368. <li><b>tracepath/tracepath6</b> - trace network path (iputils)</li>
  369. <li><b>traceroute/traceroute6</b> - trace network route (iputils)</li>
  370. </ul>
  371. <p>The names in parentheses are the upstream source of the command.</p>
  372. <h3>Analysis</h3>
  373. <p>For reference, combining everything listed above that's still "fair game"
  374. for toybox, we get:</p>
  375. <blockquote><b>
  376. arping blkid e2fsck dd fsck.f2fs fsck_msdos gzip ip iptables
  377. ip6tables iw logwrapper make_ext4fs make_f2fs modpobe newfs_msdos ping ping6
  378. reboot resize2fs sh ss tc tracepath tracepath6 traceroute traceroute6
  379. </b></blockquote>
  380. <p>We may eventually implement all of that, but for toybox 1.0 we need to
  381. focus a bit. If Android has an acceptable external package, and the command
  382. isn't needed for system bootstrapping, replacing the external package is
  383. not a priority.</p>
  384. <p>However, several commands toybox plans to implement anyway could potentially
  385. replace existing Android versions, so we should take into account Android's use
  386. cases when doing so. This includes:</p>
  387. <blockquote><b>
  388. <span id=toolbox>
  389. dd getevent gzip modprobe newfs_msdos sh
  390. </span>
  391. </b></blockquote>
  392. <p>Update: <a href=https://android.googlesource.com/platform/system/core/+/master/system/core/Android.bp>
  393. external/toybox/Android.bp</a> has symlinks for the following toys out
  394. of "pending". (The toybox modprobe is also built for the device, but
  395. it isn't actually used and is only there for sanity checking against
  396. the libmodprobe-based implementation.) These should be a priority for
  397. cleanup:</p>
  398. <blockquote><b>
  399. bc dd diff expr getfattr lsof more stty tr traceroute
  400. </b></blockquote>
  401. <p>Android wishlist:</p>
  402. <blockquote><b>
  403. mtools genvfatfs mke2fs gene2fs
  404. </b></blockquote>
  405. <hr />
  406. <h2><a name=aosp /><a href="#aosp">Use case: Building AOSP</a></h2>
  407. <p>The list of external tools used to build AOSP was
  408. <a href="https://android.googlesource.com/platform/build/soong/+/master/ui/build/paths/config.go">here</a>,
  409. but as they're switched over to toybox they disappear and reappear
  410. <a href="https://android.googlesource.com/platform/prebuilts/build-tools/+/refs/heads/master/path/linux-x86/">here</a>.</p>
  411. <blockquote><b>
  412. awk basename bash bc bzip2 cat chmod cmp comm cp cut date dd diff dirname du
  413. echo egrep env expr find fuser getconf getopt git grep gzip head hexdump
  414. hostname id jar java javap ln ls lsof m4 make md5sum mkdir mktemp mv od openssl
  415. paste patch pgrep pkill ps pstree pwd python python2.7 python3 readlink
  416. realpath rm rmdir rsync sed setsid sh sha1sum sha256sum sha512sum
  417. sleep sort stat tar tail tee todos touch tr true uname uniq unix2dos unzip
  418. wc which whoami xargs xxd xz zip zipinfo
  419. </b></blockquote>
  420. <p>The following are already in the tree and will be used directly:</p>
  421. <blockquote><b>
  422. awk bzip2 jar java javap m4 make python python2.7 python3 xz
  423. </b></blockquote>
  424. <p>Subtracting what's already in toybox (including the following toybox toys
  425. that are still in pending: <code>bc dd diff expr gzip lsof tar tr</code>),
  426. that leaves:</p>
  427. <blockquote><b>
  428. bash fuser getopt git hexdump openssl pstree rsync sh todos unzip zip zipinfo
  429. </b></blockquote>
  430. <p>For AOSP, zip/zipinfo/unzip are likely to be libziparchive based. The
  431. todos callers will use unix2dos instead if it's available. git/openssl
  432. seem like they should just be brought in to the tree. rsync is used to
  433. work around a Mac <code>cp -Rf</code> bug with broken symbolic links. That
  434. leaves:</p>
  435. <blockquote><b>
  436. bash fuser getopt hexdump pstree
  437. </b></blockquote>
  438. <p>(Why are fuser and pstree used during the AOSP build? They're used for
  439. diagnostics if something goes wrong. So it's really just bash, getopt,
  440. and hexdump that are actually used to build.)</p>
  441. <hr />
  442. <h2><a name=tizen /><a href="#tizen">Use case: Tizen Core</a></h2>
  443. <p>A side effect of the Linux Foundation following the money to the
  444. exclusion of all else is they "support" their donors' myriad often
  445. contradictory pet projects with elaborate announcements and press releases.
  446. Long ago when Nokia's Maemo merged
  447. with Intel's Moblin to form <a href=https://www.linuxfoundation.org/press-release/linux-foundation-to-host-meego-project/>MeeGo</a>, there were believable <a href=https://www.linuxfoundation.org/press-release/public-support-for-the-meego-project/>statements</a>
  448. about unifying fragmented vendor efforts. Then MeeGo merged with
  449. <a href=http://en.wikipedia.org/wiki/LiMo_Foundation>LiMo</a> to
  450. <a href=notes-2012.html#16-05-2012>form Tizen</a>,
  451. which became a Samsung-only project (that <a href=https://www.androidheadlines.com/2021/05/samsung-tvs-continue-use-tizen-os.html>still ships</a>
  452. inside <a href=https://twitter.com/cstross/status/1453747613686288385>televisions</a>,
  453. but was otherwise subsumed into <a href=https://www.theverge.com/2021/5/18/22440483/samsung-smartwatch-google-wearos-tizen-watch>Android GO</a>).</p>
  454. <p>Along the way, the Tizen project expressed a desire to eliminate GPLv3 software
  455. from its core system, and in installing toybox as
  456. <a href=https://wiki.tizen.org/wiki/Toybox>part of this process</a>.</p>
  457. <p>They had a fairly long list of new commands they wanted to see in toybox:</p>
  458. <blockquote><b>
  459. <span id=tizen_cmd>
  460. arch base64 users unexpand shred join csplit
  461. hostid nproc runcon sha224sum sha256sum sha384sum sha512sum sha3sum mkfs.vfat fsck.vfat
  462. dosfslabel uname pinky diff3 sdiff zcmp zdiff zegrep zfgrep zless zmore
  463. </span>
  464. </b></blockquote>
  465. <p>In addition, they wanted to use several commands then in pending:</p>
  466. <blockquote><b>
  467. <span id=tizen>
  468. tar diff printf wget rsync fdisk vi less tr test stty fold expr dd
  469. </span>
  470. </b></blockquote>
  471. <p>Also, tizen uses a different Linux Security Module called SMACK, so
  472. many of the SELinux options ala ls -Z needed smack alternatives in an
  473. if/else setup. We added lib/lsm.h to abstract this, but haven't heard
  474. from Tizen in years and have started implementing SELinux support without
  475. Smack support in places like tar.c. At some point, lib/lsm.h may go away
  476. due to lack of expressed interest.</p>
  477. <hr />
  478. <h2><a name=yocto /><a href="#yocto">Use case: Yocto</a></h2>
  479. <p>Another project the Linux Foundation is paid to appreciate is Yocto,
  480. which was designed to fix the ongoing proprietary fragmentation problem
  481. (now in Linux build systems instead of vendor unix forks) by being the
  482. build system equivalent of a glue trap. While proclaiming that having the
  483. "minimum level of standardization" contributes to a "strong ecosystem",
  484. Yocto uses a "<a href=https://www.yoctoproject.org/software-overview/layers/>layered</a>"
  485. design where everybody who touches it is encouraged to add more and more layers
  486. of metadata on top of what came before, until they wind up <a href=https://github.com/varigit/variscite-bsp-platform>using repo</a> just to manage
  487. the layers (let alone their contents). But -- and this is the
  488. important bit -- all these dispirate forks are called "yocto" and built on
  489. top of giant piles of code the Linux Foundation can take credit for
  490. since they filed the serial numbers off OpenEmbedded. (And THEN users
  491. are encouraged to check the result into their own repository as one
  492. big initial commit, discarding all layers and history.)</p>
  493. <p>Yocto's "core-image-minimal" target (only 3,106 build steps in the 3.3
  494. release, which includes building host versions of gnome packages and
  495. <a href=https://landley.net/notes-2019.html#06-02-2019>something called</a>
  496. the "uninative binary shim") builds a busybox-based system with the following commands:</p>
  497. <blockquote><b>
  498. <span id=yocto_cmd>
  499. addgroup adduser ascii sh awk base32 basename blkid bunzip2 bzcat bzip2 cat
  500. chattr chgrp chmod chown chroot chvt clear cmp cp cpio crc32 cut date dc dd
  501. deallocvt delgroup deluser depmod df diff dirname dmesg dnsdomainname du
  502. dumpkmap dumpleases echo egrep env expr false fbset fdisk fgrep find flock
  503. free fsck fstrim fuser getopt getty grep groups gunzip gzip head hexdump
  504. hostname hwclock id ifconfig ifdown ifup insmod ip kill killall klogd less
  505. ln loadfont loadkmap logger logname logread losetup ls lsmod lzcat md5sum
  506. mesg microcom mkdir mkfifo mknod mkswap mktemp modprobe more mount mountpoint
  507. mv nc netstat nohup nproc nslookup od openvt patch pgrep pidof pivot_root
  508. printf ps pwd rdate readlink realpath reboot renice reset resize rev rfkill
  509. rm rmdir rmmod route run-parts sed seq setconsole setsid sh sha1sum sha256sum
  510. shuf sleep sort start-stop-daemon stat strings stty sulogin swapoff swapon
  511. switch_root sync sysctl syslogd tail tar tee telnet test tftp time top touch
  512. tr true ts tty udhcpc udhcpd umount uname uniq unlink unzip uptime users
  513. usleep vi watch wc wget which who whoami xargs xzcat yes zcat
  514. </span>
  515. </b></blockquote>
  516. <a name="fhs" />
  517. <hr /><a href=fhs>Filesystem Hierachy Standard</a>
  518. <h2>Filesystem Hierarchy Standard:</h2>
  519. <p>Another standard taken over by the Linux Foundation. (At least the
  520. links to this one didn't <a href=http://lanana.org/>go 404</a> the
  521. instant they took it over). Of historical interest due to what it
  522. managed to achieve before they chased away the hobbyists maintaining it.
  523. Only one version (3.0 in 2015) has been released since the Linux Foundation
  524. absorbed the FHS. The previous release, Version 2.3, was released in 2004.
  525. The Linux Foundation did not retain earlier versions. The contents of
  526. the relevant sections appear identical between the two versions, the
  527. Linux Foundation just added section numbers.</p>
  528. <p><a href=https://refspects.linuxfoundation.org/FHS_3.0/fhs-3.0.html>FHS 3.0</a>
  529. section 3.4.2 requires commands to be in the /bin directory, and then 3.4.3
  530. has an optional list,
  531. and then 3.16.2 and 3.16.3 similarly cover /sbin. There are linux
  532. specific sections in 6.1.2 and 6.1.6 but everything in them is obsolete.</p>
  533. <p>The /bin options include csh but not bash, and ed but not vi.
  534. The /sbin options have update which seems obsolete (filesystem
  535. buffers haven't needed a userspace process to flush them for DECADES),
  536. fastboot and fasthalt (reboot and halt have -nf), and
  537. fsck.* and mkfs.* that don't actually specify any specific filesystems.
  538. Removing that gives us:</p>
  539. <blockquote><b>
  540. <span id=fhs_cmd>
  541. cat chgrp chmod chown cp date dd df dmesg echo false hostname kill ln
  542. login ls mkdir mknod more mount mv ps pwd rm rmdir sed sh stty su sync true
  543. umount uname tar cpio gzip gunzip zcat netstat ping
  544. shutdown fdisk getty halt ifconfig init mkswap reboot route swapon swapoff
  545. </span>
  546. </b></blockquote>
  547. <hr /><a name=buildroot />
  548. <h2>buildroot:</h2>
  549. <p>If a toybox-based development environment is to support running
  550. buildroot under it, the <a href=https://buildroot.org/downloads/manual/manual.html#requirement-mandatory>mandatory packages</a>
  551. section of the buildroot manual lists:</p>
  552. <blockquote><p><b>
  553. which sed make bash patch gzip bzip2 tar cpio unzip rsync file bc wget
  554. </b></p></blockquote>
  555. <p>(It also lists binutils gcc g++ perl python, and for debian it wants
  556. build-essential. And it wants file to be in /usr/bin because
  557. <a href=https://git.busybox.net/buildroot/tree/support/dependencies/dependencies.sh?h=2018.02.x#n84>libtool
  558. breaks otherwise</a>.)</p>
  559. <p>Oddly, buildroot can't NOT cross compile. Buildroot does not support a cross toolchain that lives in "/usr/bin"
  560. with a prefix of "" (if you try, and chop out the test for a blank prefix,
  561. it dies trying to run "/usr/bin/-gcc"). You can patch your way to
  562. making it work if you try, but buildroot's developers explicitly do not
  563. support this.</p>
  564. <hr /><a name=klibc />
  565. <h2>klibc:</h2>
  566. <p>Long ago some kernel developers came up with a project called
  567. <a href=http://en.wikipedia.org/wiki/Klibc>klibc</a>.
  568. After a decade of development it still has no web page or HOWTO,
  569. and nobody's quite sure if the license is BSD or GPL. It inexplicably
  570. <a href=http://www.infoworld.com/d/data-center/perl-isnt-going-anywhere-better-or-worse-211580>requires perl to build</a>, and seems like an ideal candidate for
  571. replacement.</p>
  572. <p>In addition to a C library less general-purpose than old versions of bionic
  573. (let alone musl), klibc builds a random assortment of executables to run init scripts
  574. with. There's no multiplexer command, these are individual executables:</p>
  575. <blockquote><p><b>
  576. cat chroot cpio dd dmesg false fixdep fstype gunzip gzip halt ipconfig kill
  577. kinit ln losetup ls minips mkdir mkfifo mknodes
  578. mksyntax mount mv nfsmount nuke pivot_root poweroff readlink reboot resume
  579. run-init sh sha1hash sleep sync true umount uname zcat
  580. </b></p></blockquote>
  581. <p>To get that list, build klibc according to the instructions (I
  582. <a href=http://landley.net/notes-2013.html#23-01-2013>looked at</a> version
  583. 2.0.2 and did cd klibc-*; ln -s /output/of/kernel/make/headers_install
  584. linux; make) then <b>echo $(for i in $(find . -type f); do file $i | grep -q
  585. executable && basename $i; done | grep -v '[.]g$' | sort -u)</b> to find
  586. executables, then eliminate the *.so files and *.shared duplicates.</p>
  587. <p>Some of those binaries are build-time tools that don't get installed,
  588. which removes mknodes, mksyntax, sha1hash, and fixdep from the list.
  589. (And sha1hash is just an unpolished sha1sum anyway.)</p>
  590. <p>The run-init command is more commonly called switch_root, nuke is just
  591. "rm -rf -- $@", and minips is more commonly called "ps": I'm not doing aliases
  592. for these oddball names.
  593. The "kinit" command is another gratuitous rename, it's init running as PID 1.
  594. The halt, poweroff, and reboot commands work with it.</p>
  595. <p>Yet more stale forks of dash and gzip got sucked in here (see "dubious
  596. license terms" above).</p>
  597. <p>In theory "blkid" or "file" handle fstype (and df for mounted filesystems),
  598. but we could do fstype.</p>
  599. <p>We should implement nfsmount, and probably smbmount
  600. and p9mount even though this hasn't got one. The reason these aren't
  601. in the base "mount" command is they interactively query login credentials.</p>
  602. <p>The ipconfig command here has a built in dhcp client, so it's ifconfig
  603. and dhcpcd and maybe some other stuff.</p>
  604. <p>The resume command is... weird. It finds a swap partition and reads data
  605. from it into a /proc file, something the kernel is capable of doing itself.
  606. (Even though the klibc author
  607. <a href=http://www.zytor.com/pipermail/klibc/2006-June/001748.html>attempted
  608. to remove</a> that capability from the kernel, current kernel/power/hibernate.c
  609. still parses "resume=" on the command line). And yet various distros seem to
  610. make use of klibc for this.
  611. Given the history of swsusp/hibernate (and
  612. <a href=http://lwn.net/Articles/333007>TuxOnIce</a>
  613. and <a href=http://lwn.net/Articles/242107>kexec jump</a>...) I've lost track
  614. of the current state of the art here. Ah, Documentation/power/userland-swsusp.txt
  615. has the API docs, and <a href=http://suspend.sf.net>here's a better
  616. tool</a>...</p>
  617. <p>This gives us a klibc command list:</p>
  618. <blockquote><b>
  619. <span id=klibc_cmd>
  620. cat chroot dmesg false kill ln losetup ls mkdir mkfifo readlink rm switch_root
  621. sleep sync true uname
  622. cpio dd ps mv pivot_root
  623. mount nfsmount fstype umount
  624. sh gunzip gzip zcat
  625. kinit halt poweroff reboot
  626. ipconfig
  627. resume
  628. </span>
  629. </b></blockquote>
  630. <hr />
  631. <a name=glibc />
  632. <h2>glibc</h2>
  633. <p>Rather a lot of command line utilities come bundled with glibc:</p>
  634. <blockquote><b>
  635. catchsegv getconf getent iconv iconvconfig ldconfig ldd locale localedef
  636. mtrace nscd rpcent rpcinfo tzselect zdump zic
  637. </b></blockquote>
  638. <p>Of those, musl libc only implements ldd. Of the rest:</p>
  639. <ul>
  640. <li><b>catchsegv</b> is a rudimentary debugger, probably out of scope for toybox.</li>
  641. <li><b>iconv</b> has been <a href="#susv4">previously discussed</a>.</li>
  642. <li><b>iconvconfig</b> is only relevant if iconv is user-configurable; musl uses a
  643. non-configurable iconv now that utf8+unicode exist.</li>
  644. <li><b>getconf</b> is a posix utility which displays several variables from
  645. unistd.h; it probably belongs in the development toolchain.</li>
  646. <li><b>getent</b> handles retrieving entries from passwd-style databases
  647. (in a rather lame way) and is trivially replacable by grep.</li>
  648. <li><b>locale</b> was discussed under <a href=#susv4>posix</a>.
  649. localedef compiles locale definitions, which musl currently does not use.</li>
  650. <li><b>mtrace</b> is a perl script to use the malloc debugging that glibc has built-in;
  651. this is not relevant for musl, and would necessarily vary with libc.</li>
  652. <li><b>nscd</b> is a name service caching daemon, which is not yet relevant for musl.</li>
  653. <li><b>rpcinfo</b> and <b>rpcent</b> are related to the Remote Procedure Calls
  654. layer (an old sun technology used by some userspace NFS implementations),
  655. which musl does not include and debian does not install by default.</li>
  656. </ul>
  657. <p>The remaining commands involve glibc's bundled timezone database,
  658. which seems to be derived from the <a href=http://www.iana.org/time-zones>IANA
  659. timezone database</a>. Unless we want to maintain our own fork of the
  660. standards body's database like glibc does, these are of no interest,
  661. but for completeness:</p>
  662. <ul>
  663. <li><b>tzselect</b> outputs a TZ variable correponding to user input.
  664. The documentation does not indicate how to use it in a script, but it seems
  665. that Debian may have done so.</li>
  666. <li><b>zdump</b> prints current time in each of several timezones, optionally
  667. outputting a great deal of extra information about each timezone.</li>
  668. <li><b>zic</b> converts a description of a timezone to a file in tz format.</li>
  669. </ul>
  670. <p>We implemented getconf, and I could see maybe arguing for ncsd.
  671. The rest are not relevant to toybox.</p>
  672. </b></blockquote>
  673. <hr />
  674. <a name=sash />
  675. <h2>Stand-Alone Shell</h2>
  676. <p>Wikipedia has <a href=http://en.wikipedia.org/wiki/Stand-alone_shell>a good
  677. summary of sash</a>, with links. The original Stand-Alone Shell project reached
  678. a stopping point, and then <a href=http://www.baiti.net/sash>"sash plus
  679. patches"</a> extended it a bit further. The result is a megabyte executable
  680. that provides 40 commands.</p>
  681. <p>Sash is a shell with built-in commands. It doesn't have a multiplexer
  682. command, meaning "sash ls -l" doesn't work (you have to go "sash -c 'ls -l'").
  683. </p>
  684. <p>The list of commands can be obtained via building it and doing
  685. "echo help | ./sash | awk '{print $1}' | sed 's/^-//' | xargs echo", which
  686. gives us:</p>
  687. <blockquote><b>
  688. alias aliasall ar cd chattr chgrp chmod chown cmp cp chroot dd echo ed exec
  689. exit file find grep gunzip gzip help kill losetup losetup ln ls lsattr mkdir
  690. mknod more mount mv pivot_root printenv prompt pwd quit rm rmdir setenv source
  691. sum sync tar touch umask umount unalias where
  692. </b></blockquote>
  693. <p>Plus sh because it's a shell. A dozen or so commands can only sanely be
  694. implemented as shell builtins (alias aliasall cd exec exit prompt quit setenv
  695. source umask unalias), and where is an alias for which.</p>
  696. <p>This leaves:</p>
  697. <blockquote><b>
  698. <span id=sash_cmd>
  699. chgrp chmod chown cmp cp chroot echo find grep help kill losetup
  700. ln ls mkdir mknod mount mv pivot_root printenv pwd rm rmdir sync tar touch umount
  701. ar chattr dd ed file gunzip gzip lsattr more sh
  702. </span>
  703. </b></blockquote>
  704. <p>(For once, this project doesn't include a fork of gzip, instead
  705. it sucks in -lz from the host.)</p>
  706. <hr />
  707. <a name=sbase />
  708. <h2>sbase:</h2>
  709. <p>It's <a href=http://git.suckless.org/sbase>on suckless</a> in
  710. <a href=http://git.suckless.org/ubase>two parts</a>. As of November 2015 it's
  711. implemented the following (renaming "cron" to "crond" for
  712. consistency, and yanking "sponge", "mesg", "pagesize", "respawn", and
  713. "vtallow"):</p>
  714. <blockquote><p>
  715. <span id=sbase_cmd>
  716. basename cal cat chgrp chmod chown chroot cksum cmp comm cp crond cut date
  717. dirname du echo env expand expr false find flock fold getconf grep head
  718. hostname join kill link ln logger logname ls md5sum mkdir mkfifo mktemp mv
  719. nice nl nohup od paste printenv printf pwd readlink renice rm rmdir sed seq
  720. setsid sha1sum sha256sum sha512sum sleep sort split strings sync tail
  721. tar tee test tftp time touch tr true tty uname unexpand uniq unlink uudecode
  722. uuencode wc which xargs yes
  723. </span>
  724. </p></blockquote>
  725. <p>and<p>
  726. <blockquote><p>
  727. <span id=sbase_cmd>
  728. chvt clear dd df dmesg eject fallocate free id login mknod mountpoint
  729. passwd pidof ps stat su truncate unshare uptime watch
  730. who
  731. </span>
  732. </p></blockquote>
  733. <hr />
  734. <a name=nash />
  735. <h2>nash:</h2>
  736. <p>Red Hat's nash was part of its "mkinitrd" package, replacement for a shell
  737. and utilities on the boot floppy back in the 1990's (the same general idea
  738. as BusyBox, developed independently). Red Hat discontinued nash development
  739. in 2010, replacing it with dracut (which collects together existing packages,
  740. including busybox).</p>
  741. <p>I couldn't figure out how to beat source code out of
  742. <a href=http://pkgs.fedoraproject.org/git/mkinitrd>Fedora's current git</a>
  743. repository. The last release version that used it was Fedora Core 12
  744. which has <a href=http://archive.fedoraproject.org/pub/archive/fedora/linux/releases/12/Fedora/source/SRPMS/mkinitrd-6.0.93-1.fc12.src.rpm>a source rpm</a>
  745. that can be unwound with "rpm2cpio mkinitrd.src.rpm | cpio -i -d -H newc
  746. --no-absolute-filenames" and in there is a mkinitrd-6.0.93.tar.bz2 which
  747. has the source.</p>
  748. <p>In addition to being a bit like a command shell, the nash man page lists the
  749. following commands:</p>
  750. <blockquote><p>
  751. access echo find losetup mkdevices mkdir mknod mkdmnod mkrootdev mount
  752. pivot_root readlink raidautorun setquiet showlabels sleep switchroot umount
  753. </p></blockquote>
  754. <p>Oddly, the only occurrence of the string pivot_root in the nash source code
  755. is in the man page, the command isn't there. (It seems to have been removed
  756. when the underscoreless switchroot went in.)</p>
  757. <p>A more complete list seems to be the handlers[] array in nash.c:</p>
  758. <blockquote><p>
  759. access buildEnv cat cond cp daemonize dm echo exec exit find kernelopt
  760. loadDrivers loadpolicy mkchardevs mkblktab mkblkdevs mkdir mkdmnod mknod
  761. mkrootdev mount netname network null plymouth hotplug killplug losetup
  762. ln ls raidautorun readlink resume resolveDevice rmparts setDeviceEnv
  763. setquiet setuproot showelfinterp showlabels sleep stabilized status switchroot
  764. umount waitdev
  765. </p></blockquote>
  766. <p>This list is nuts: "plymouth" is an alias for "null" which is basically
  767. "true" (which the above list doesn't have). Things like buildEnv and
  768. loadDrivers are bespoke Red Hat behavior that might as well be hardwired in
  769. to nash's main() without being called.</p>
  770. <p>Instead of eliminating items
  771. from the list with an explanation for each, I'm just going to cherry pick
  772. a few: the device mapper (dm, raidautorun) is probably interesting,
  773. hotplug (may be obsolete due to kernel changes that now load firmware
  774. directly), and another "resume" ala klibc.</p>
  775. <p>But mostly: I don't care about this one. And neither does Red Hat anymore.</p>
  776. <p>Verdict: ignore</p>
  777. <hr />
  778. <a name=beastiebox />
  779. <h2>Beastiebox</h2>
  780. <p>Back in 2008, the BSD guys vented some busybox-envy
  781. <a href=http://beastiebox.sourceforge.net>on sourceforge</a>. Then stopped.
  782. Their repository is still in CVS, hasn't been touched in years, it's a giant
  783. hairball of existing code sucked together. (The web page says the author
  784. is aware of crunchgen, but decided to do this by hand anyway. This is not
  785. a collection of new code, it's a katamari of existing code rolled up in a
  786. ball.)</p>
  787. <p>Combining the set of commands listed on the web page with the set of
  788. man pages in the source gives us:</P>
  789. <blockquote><p>
  790. [ cat chmod cp csh date df disklabel dmesg echo ex fdisk fsck fsck_ffs getty
  791. halt hostname ifconfig init kill less lesskey ln login ls lv mksh more mount
  792. mount_ffs mv pfctl ping poweroff ps reboot rm route sed sh stty sysctl tar test
  793. traceroute umount vi wiconfig
  794. </p></blockquote>
  795. <p>Apparently lv is the missing link between ed and vi, copyright 1982-1997 (do
  796. not want), ex is another obsolete vi mode, lesskey is "used to
  797. specify a set of key bindings to be used with less", and csh is a shell they
  798. sucked in (even though they have mksh?), [ is an alias for test. Several more bsd-isms that don't have Linux
  799. equivalents (even in the ubuntu "install this package" search) are
  800. disklabel, fsck_ffs, mount_ffs, and pfctl. And wiconfig is a
  801. wavelan interface network card driver utility. Subtracting all that and the
  802. commands toybox already implements at triage time, we get:</p>
  803. <blockquote><p>
  804. <span id=beastiebox_cmd>
  805. fdisk fsck getty halt ifconfig init kill less more mount mv ping poweroff
  806. ps reboot route sed sh stty sysctl tar test traceroute umount vi
  807. </span>
  808. </p></blockquote>
  809. <p>Not a hugely interesting list, but eh.</p>
  810. <p>Verdict: ignore</p>
  811. <hr />
  812. <a name=BsdBox />
  813. <h2>BsdBox</h2>
  814. <p>Somebody decided to do a <a href=https://wiki.freebsd.org/AdrianChadd/BsdBox>multicall binary for freebsd</a>.</p>
  815. <p>They based it on crunchgen, a tool that glues existing programs together
  816. into an archive and uses the name to execute the right one. It has no
  817. simplification or code sharing benefits whatsoever, it's basically an
  818. archiver that produces executables.</p>
  819. <p>That's about where I stopped reading.</p>
  820. <p>Verdict: ignore.</p>
  821. <hr />
  822. <a name=slowaris />
  823. <h2>OpenSolaris Busybox</h2>
  824. <p>Somebody <a href=http://hub.opensolaris.org/bin/view/Project+busybox/>wrote
  825. a wiki page</a> saying that Busybox for OpenSolaris would be a good idea.</p>
  826. <p>The corresponding "files" tab is an auto-generated stub. The project never
  827. even got as far as suggesting commands to include before Oracle discontinued
  828. OpenSolaris.</p>
  829. <p>Verdict: ignore.</p>
  830. <hr />
  831. <a name=uclinux />
  832. <h2>uClinux</h2>
  833. <p>Long ago a hardware developer named Jeff Dionne put together a
  834. nommu Linux distribution, which involved rewriting a lot of command line
  835. utilities that relied on <a href=http://nommu.org/memory-faq.txt>features
  836. unavailable on nommu</a> hardware.</p>
  837. <p>In 2003 Jeff moved to Japan and handed
  838. the project off to people who allowed it to roll to a stop. The website
  839. turned into a mess of 404 links, the navigation indexes stopped being
  840. updated over a decade ago, and the project's CVS repository suffered a
  841. hard drive failure for which there were no backups. The project continued
  842. to put out "releases" through 2014 (you have to scroll down in the "news"
  843. section to find them, the "HTTP download" section in the nav bar on the
  844. left hasn't been updated in over a decade), which were hand-updated tarball
  845. snapshots mostly consisting of software from the 1990's. For example the
  846. 2014 release still contained ipfwadm, the package which predated ipchains,
  847. which predated iptables, which is in the process of being replaced by
  848. nftables.</p>
  849. <p>Nevertheless, people still try to use this because the project was viewed
  850. as the place to discuss, develop, and learn about nommu Linux.
  851. The role of uclinux.org as an educational resource kept people coming
  852. to it long after it had collapsed as a Linux distro.</p>
  853. <p>Starting around 0.6.0 toybox began to address nommu support with the goal
  854. of putting uClinux out of its misery.</p>
  855. <p>An analysis of <a href=http://www.uclinux.org/pub/uClinux/dist/uClinux-dist-20140504.tar.bz2>uClinux-dist-20140504</a> found 312 package
  856. subdirectories under "user".</p>
  857. <h3>Taking out the trash</h3>
  858. <p>A bunch of packages (<b>inotify-tools, input-event-demon, ipsec-tools, netifd,
  859. keepalived, mobile-broadband-provider-info, nuttp, readline, snort,
  860. snort-barnyard, socat, sqlite, sysklogd, sysstat, tcl, ubus, uci, udev,
  861. unionfs, uqmi, usb_modeswitch, usbutils, util-linux</b>)
  862. are hard to evaluate because
  863. uclinux has directories for them, but their source isn't actually in the
  864. uclinux tree. In some of these the makefiles download a git repo during
  865. the build, so I'm assuming you can build the external package if you really
  866. care. (Even when I know what these packages do, I'm skipping them
  867. because uclinux doesn't actually contain them, and any given snapshot
  868. of the build system will bitrot as external web links change over time.)</p>
  869. <p>Other packages are orphaned, meaning they're not mentioned from any Kconfig
  870. or Makefiles outside of their directory, so uclinux can't actually build
  871. them: <b>mbus</b> is an orphaned i2c test program expecting to run in some sort
  872. of hardwired hardware context, <b>mkeccbin</b> is an orphaned "ECC annotated
  873. binary file" generator (meaning it's half of a flash writer),
  874. <b>wsc_upnp</b> is a "Ralink WPS" driver (some sort of stale wifi chip)...</p>
  875. <p>The majority of the remaining packages are probably not of interest to
  876. toybox due to being so obsolete or special purpose they may not actually be
  877. of interest to anybody anymore. (This list also includes a lot of
  878. special-purpose network back-end stuff that's hard for anybody but
  879. datacenter admins to evaluate the current relevance of.)</p>
  880. <blockquote><b><p>
  881. arj asterisk boottools bpalogin br2684ctl camserv can4linux cgi_generic
  882. cgihtml clamav clamsmtp conntrack-tools cramfs crypto-tools cxxtest
  883. ddns3-client de2ts-cal debug demo diald discard dnsmasq dnsmasq2
  884. ethattach expat-examples ez-ipupdate fakeidentd
  885. fconfig ferret flatfs flthdr freeradius freeswan frob-led frox fswcert
  886. game gettyd gnugk haserl horch
  887. hostap hping httptunnel ifattach ipchains
  888. ipfwadm ipmasqadm ipportfw ipredir ipset iso_client
  889. jamvm jffs-tools jpegview jquery-ui kendin-config kismet klaxon kmod
  890. l2tpd lcd ledcmd ledcon lha lilo lirc lissa load loattach
  891. lpr lrpstat lrzsz mail mbus mgetty microwin ModemManager msntp musicbox
  892. nooom null openswan openvpn palmbot pam_* pcmcia-cs playrt plugdaemon pop3proxy
  893. potrace qspitest quagga radauth
  894. ramimage readprofile rdate readprofile routed rrdtool rtc-ds1302
  895. sendip ser sethdlc setmac setserial sgutool sigs siproxd slattach
  896. smtpclient snmpd net-snmp snortrules speedtouch squashfs scep sslwrap stp
  897. stunnel tcpblast tcpdump tcpwrappers threaddemos tinylogin tinyproxy
  898. tpt tripwire unrar unzoo version vpnled w3cam xl2tpd zebra
  899. </p></b></blockquote>
  900. <p>This stuff is all over the place: arj, lha, rar, and zoo are DOS archivers,
  901. ethattach describes itself as just "a network tool",
  902. mail is a textmode smtp mailer literally described as "Some kind of mail
  903. proggy" in uclinux's kconfig (as opposed to clamsmtp and smtpclient and
  904. so on), this gettyd isn't a generic version but specifically a
  905. hardwired ppp dialin utility, mgetty isn't a generic version but is combined
  906. with "sendfax", hostap is an intersil prism driver, wlan-ng is also an
  907. intersil prism dirver, null is a program to intentionally dereference a
  908. null pointer (in case you needed one), iso_client is a
  909. "Demo Application for the USB Device Driver", kendin-config is
  910. "for configuring the Micrel Kendin KS8995M over QSPI", speedtouch configures
  911. a specific brand of asdl modem, portmap is part of Anfs,
  912. ferret, linux-igd, and miniupnp are all upnp packages,
  913. lanbypass "can be used to control the LAN
  914. bypass switches on the Advantech x86 based hardware platforms", lcd is
  915. "test of lcddma device driver" (an out-of-tree Coldfire driver apparently
  916. lost to history, the uclinux linux-2.4.x directory has a config symbol for
  917. it, but nothing in the code actually _uses_ it...), qspitest is another
  918. coldfire thing, mii-tool-fec is
  919. "strictly for the FEC Ethernet driver as implemented (and modified) for
  920. the uCdimm5272", rtc-ds1302 and rtc-m41t11 are usermode drivers for specific
  921. clock chips, stunnel is basically "openssl s_client -quiet -connect",
  922. potrace is a bitmap to vector graphic converter, radauth performs command line
  923. authentication against a radius server,
  924. clamav, klaxon, ferret, l7-protocols, and nessus are very old network security
  925. software (it's got a stale snapshot of nmap too), xl2tpd is a PPP over UDP
  926. tunnel (rfc 2661), zebra is the package quagga replaced,
  927. lilo is the x86-only bootloader that predated grub (and recently discontinued
  928. development), lissa is a "framebuffer graphics demo" from
  929. 1998, the squashfs package here is the out of tree patches for 2.4 kernels
  930. and such before the filesystem was merged upstream (as opposed to the
  931. squashfs-new package which is a snapshot of the userspace tool from 2011),
  932. load is basically "dd file /dev/spi", version is basically "cat /proc/version",
  933. microwin is a port of the WinCE graphics API to Linux, scep is a 2003
  934. implementation of an IETF draft abandoned in 2010, tpt depends on
  935. Andrew Morton's 15 year old unmerged "timepegs" kernel patch using the pentium
  936. cycle counter, vpnled controls a light that reboots systems (what?),
  937. w3cam is a video4linux 1.0 client (v4l2 showed up during 2.5 and support for
  938. the old v4l1 was removed in 2.6.38 back in 2011), busybox ate tinylogin
  939. over a decade ago, lrpstat is a java network monitor
  940. from 2001, lrzsz is zmodem/ymodem/zmodem, msntp and stp implement rfc2030
  941. meaning it overflows in 2036 (the package was last updated in 2000), rdate
  942. is rfc 868 meaning it also overflows in 2036 (which is why ntp was invented
  943. a few decades back), reiserfsprogs development stopped abruptly after
  944. Hans Reiser was convicted of murdering his wife Nina (denying it on the
  945. stand and then leading them to the body as part of his plea bargain during
  946. sentencing)...
  947. </p>
  948. <p>Seriously, there's a lot of crap in there. It's hard to analyze most
  949. of it far enough to prove it _doesn't_ do anything.</p>
  950. <h3>Non-toybox programs</h3>
  951. <p>The following software may actually still do something intelligible
  952. (although the package versions tend to be years out of date), but
  953. it's not a direction toybox has chosen to go in.</p>
  954. <p>There are several programming languages (<b>bash, lua, jamvm, tinytcl,
  955. perl, python</b>) in there. Maybe someone somewhere wants a 2008 release of a
  956. java virtual machine tested to work on nommu systems (jamvm), but it's out
  957. of scope for toybox.</p>
  958. <p>A bunch of benchmark programs: <b>cpu, dhrystone, mathtest, nbench, netperf,
  959. netpipe, and whetstone</b>.</p>
  960. <p>A bunch of web servers: <b>appWeb, boa, fnord (via tcpserver), goahead, httpd,
  961. mini_httpd, and thttpd</b>.</p>
  962. <p>A bunch of shells: <b>msh</b> is a clever (I.E. obfuscated) little shell,
  963. <b>nwsh</b> is "new shell" (that's what it called itself in 1999 anyway),
  964. <b>sash</b> is another shell with a bunch of builtins (ls, ps, df, cp, date, reboot,
  965. and shutdown, this roadmap analyzes it <a href="#sash">elsewhere</a>),
  966. <b>sh</b> is a very old minix shell fork, and <b>tcsh</b> is also a shell.</p>
  967. <p>Also in this category, we have:</p>
  968. <blockquote><b><p>
  969. dropbear jffs-tools jpegview kexec-tools bind ctorrent
  970. iperf iproute2 ip-sentinel iptables kexec
  971. nmap oggplay openssl oprofile p7zip pppd pptp play vplay
  972. hdparm mp3play at clock
  973. mtd-utils mysql logrotate brcfg bridge-utils flashw
  974. ebtables etherwake ethtool expect gdb gdbserver hostapd
  975. lm_sensors load netflash netstat-nat
  976. radvd recover rootloader resolveip rp-pppoe
  977. rsyslog rsyslogd samba smbmount squashfs-new squid ssh strace tip
  978. uboot-envtools ulogd usbhubctrl vconfig vixie-cron watchdogd
  979. wireless_tools wpa_supplicant
  980. </p></b></blockquote>
  981. <p>An awful lot of those are borderline: play and vplay are wav file
  982. audio players, there's oprofile _and_ readprofile (which just reads kernel
  983. profiling data from /proc/profile),
  984. radvd is a "routr advertisement daemon" (ipv6 stateless autoconf),
  985. ctorrent is a bittorent client,
  986. lm_sensors is hardware (heat?) monitoring,
  987. resolveip is dig only less so,
  988. rp-pppoe is ppp over ethernet,
  989. ebtables is an ethernet version of iptables (for bridging),
  990. their dropbear is from 2012, and that ssh version is from 2011
  991. (which means it's about nine months too _old_ to have the heartbleed bug).
  992. There's both ulogd and ulogd2 (no idea why), and pppd is version 2.4 but
  993. there's a ppd-2.3 directory also. We used to be interested in ftpd/proftpd
  994. as a way of uploading files out of a vm, but support for that has waned
  995. over the years and there are lots of alternatives.</p>
  996. <p>Lots of flash stuff:
  997. flashw is a flash writer, load is an spi flash loader, netflash writes
  998. to flash via tftp,
  999. recover is also a reflash daemon intended to come up when the system can't boot,
  1000. rootloader seems to be another reflash daemon but without dhcp.</p>
  1001. <h3>Already in roadmap</h3>
  1002. <p>The following packages contain commands already in the toybox roadmap:</p>
  1003. <blockquote><b><p>
  1004. agetty cal cksum cron dhcpcd dhcpcd-new dhcpd dhcp-isc dosfstools e2fsprogs
  1005. elvis-tiny levee fdisk fileutils ftp grep hd hwclock inetd init ntp
  1006. iputils login module-init-tools netcat shutils ntpdate lspci ping procps
  1007. rsync shadow shutils stty sysutils telnet telnetd tftp tftpd traceroute
  1008. unzip wget mawk net-tools
  1009. </p></b></blockquote>
  1010. <p>There are some duplicates in there, levee is a tiny vi implementation
  1011. like elvis-tiny, ntp and ntpdate overlap, etc.</p>
  1012. <p>Verdict: We don't really need to do a whole lot special for nommu
  1013. systems, just get the existing toybox roadmap working on nommu and
  1014. we're good. The uClinux project can rest in peace.</p>
  1015. <hr />
  1016. <h2>Requests:</h2>
  1017. <p>The following additional commands have been requested (and often submitted)
  1018. by various users. I _really_ need to clean up this section.</p>
  1019. <p>Also:</p>
  1020. <blockquote><b>
  1021. <span id=request>
  1022. dig freeramdisk getty halt hexdump hwclock klogd modprobe ping ping6 pivot_root
  1023. poweroff readahead rev sfdisk sudo syslogd taskset telnet telnetd tracepath
  1024. traceroute unzip usleep vconfig zip free login modinfo unshare netcat help w
  1025. iwconfig iwlist rdate
  1026. dos2unix unix2dos catv clear
  1027. pmap realpath setsid timeout truncate
  1028. mkswap swapon swapoff
  1029. count oneit fstype
  1030. acpi blkid eject pwdx
  1031. sulogin rfkill bootchartd
  1032. arp makedevs sysctl killall5 crond crontab deluser last mkpasswd watch
  1033. blockdev rpm2cpio arping brctl dumpleases fsck
  1034. tcpsvd tftpd
  1035. factor fallocate fsfreeze inotifyd lspci nbd-client partprobe strings
  1036. base32 base64 mix
  1037. reset hexedit nsenter shred
  1038. fsync insmod ionice lsmod lsusb rmmod vmstat xxd top iotop
  1039. lsof ionice compress dhcp dhcpd addgroup delgroup host iconv ip
  1040. ipcrm ipcs netstat openvt
  1041. deallocvt iorenice
  1042. udpsvd adduser
  1043. microcom tunctl chrt getfattr setfattr
  1044. kexec
  1045. ascii crc32 devmem fmt i2cdetect i2cdump i2cget i2cset mcookie prlimit sntp ulimit uuidgen dhcp6 ipaddr iplink iproute iprule iptunnel cd exit toysh bash traceroute6
  1046. blkdiscard rtcwake
  1047. watchdog
  1048. pwgen readelf unicode
  1049. rsync
  1050. linux32 hd strace
  1051. gpiodetect gpiofind gpioget gpioinfo gpioset httpd uclampset
  1052. </span>
  1053. </b></blockquote>
  1054. <hr />
  1055. <a name=packages />
  1056. <h2>Other packages</h2>
  1057. <p>System administrators have <a href=https://github.com/landley/toybox/issues/168#issuecomment-583725500>asked</a> what other Linux packages toybox commands
  1058. replace, so they can annotate alternatives in their package management system.</p>
  1059. <p>This section uses the package definitions from Chapter 6 of
  1060. <a href=http://www.linuxfromscratch.org/lfs/downloads/9.0/LFS-BOOK-9.0-NOCHUNKS.html>Linux From Scratch 9.0</a>). Each package lists what we currently
  1061. replace, pending commands [in square brackets], and what we DON'T plan to
  1062. implement.</p>
  1063. <p>Each "see also" note means the listed package also installs the listed shared
  1064. libraries. (While toybox contains equivalent functionality to a lot of these
  1065. shared libraries in its lib/ directory, it does not currently provide a shared
  1066. library interface.)</p>
  1067. <h3>Packages toybox plans to provide complete-ish replacements for:</h3>
  1068. <ul>
  1069. <li><b>file</b>: file (see also: libmagic)</li>
  1070. <li><b>m4</b>: [m4]</li>
  1071. <li><b>bc</b>: [bc] [dc]</li>
  1072. <li><b>bison</b>: [yacc] (not: bison, see also: liby)</li>
  1073. <li><b>flex</b>: [lex] (not: flex flex++, see also: libfl)</li>
  1074. <li><b>make</b>: [make]</li>
  1075. <li><b>sed</b>: sed</li>
  1076. <li><b>grep</b>: grep egrep fgrep</li>
  1077. <li><b>bash</b>: bash sh (not: bashbug)</li>
  1078. <li><b>diffutils</b>: cmp [diff] [diff3] [sdiff]</li>
  1079. <li><b>gawk</b>: [awk] (not: gawk gawk-5.0.1)</li>
  1080. <li><b>findutils</b>: find xargs (not: locate updatedb)</li>
  1081. <li><b>less</b>: less (not: lessecho lesskey)</li>
  1082. <li><b>gzip</b>: zcat [gzip] [gunzip] [zcmp] [zdiff] [zegrep] [zfgrep] [zgrep] [zless] [zmore]
  1083. (not: gzexe uncompress zforce znew)</li>
  1084. <li><b>patch</b>: patch</li>
  1085. <li><b>tar</b>: tar</li>
  1086. <li><b>procps-ng</b>: free pgrep pidof pkill ps sysctl top uptime vmstat w watch
  1087. [pmap] [pwdx] [slabtop]
  1088. (not: tload, see also libprocps)</li>
  1089. <li><b>sysklogd</b>: [klogd] [syslogd]</li>
  1090. <li><b>sysvinit</b>: [init] halt poweroff reboot killall5 [shutdown]
  1091. (not telinit runlevel fstab-decode bootlogd)</li>
  1092. <li><b>man</b>: man (but not accessdb apropos catman lexgrog mandb manpath whatis,
  1093. see also libman libmandb)</li>
  1094. <li><b>vim</b>: vi xxd (but not ex, rview, rvim, view, vim, vimdiff, vimtutor)</li>
  1095. <li><b>sysvinit</b>: [init] halt poweroff reboot killall5 [shutdown]
  1096. (not telinit runlevel fstab-decode bootlogd)</li>
  1097. <li><b>kmod</b>: insmod lsmod rmmod modinfo [modprobe]
  1098. (not: depmod kmod)</li>
  1099. <li><b>attr</b>: [getfattr] setfattr (not: attr, see also: libattr)</li>
  1100. <li><b>shadow</b>: [chfn] [chpasswd] [chsh] [groupadd] [groupdel] [groupmod]
  1101. [newusers] passwd [su] [useradd] [userdel] [usermod]
  1102. [lastlog] [login] [newgidmap] [newuidmap]
  1103. (not: chage expiry faillog groupmems grpck logoutd newgrp nologin pwck sg
  1104. vigr vipw, grpconv grpunconv pwconv pwunconv, chgpasswd gpasswd)</li>
  1105. <li><b>psmisc</b>: killall [fuser] [pstree] [peekfd] [prtstat]
  1106. (not: pslog pstree.x11)</li>
  1107. <li><b>inetutils</b>: dnsdomainname [ftp] hostname ifconfig ping ping6 [telnet] [tftp] [traceroute] (not: talk)</li>
  1108. <li><b>coreutils</b>: [ base32 base64 basename cat chgrp chmod chown chroot cksum comm cp cut date
  1109. dd df dirname du echo env expand factor false fmt fold groups head hostid id install
  1110. link ln logname ls md5sum mkdir mkfifo mknod mktemp mv nice nl nohup nproc od
  1111. paste printenv printf pwd readlink realpath rm rmdir seq sha1sum shred
  1112. sleep sort split stat sync tac tail tee test timeout touch true truncate
  1113. tty uname uniq unlink wc who whoami yes
  1114. [expr] [fold] [join] [numfmt] [runcon] [sha224sum] [sha256sum] [sha384sum]
  1115. [sha512sum] [stty] [b2sum] [tr] [unexpand]
  1116. (not: basenc chcon csplit dir dircolors pathchk
  1117. pinky pr ptx shuf stdbuf sum tsort users vdir, see also libstdbuf)</li>
  1118. <li><b>util-linux</b>: blkid blockdev cal chrt dmesg eject fallocate flock hwclock
  1119. ionice kill logger losetup mcookie mkswap more mount mountpoint nsenter
  1120. pivot_root prlimit rename renice rev setsid swapoff swapon switch_root taskset
  1121. umount unshare uuidgen
  1122. [addpart] [fdisk] [findfs] [findmnt] [fsck] [fsfreeze] [fstrim] [getopt]
  1123. [hexdump] [linux32] [linux64] [lsblk] [lscpu] [lsns] [setarch]
  1124. (not: agetty blkdiscard blkzone cfdisk chcpu chmem choom col
  1125. colcrt colrm column ctrlaltdel delpart fdformat fincore fsck.cramfs
  1126. fsck.minix ipcmk ipcrm ipcs isosize last lastb ldattach look lsipc
  1127. lslocks lslogins lsmem mesg mkfs mkfs.bfs mkfs.cramfs mkfs.minix namei partx
  1128. raw readprofile resizepart rfkill rtcwake script scriptreplay
  1129. setterm sfdisk sulogin swaplabel ul
  1130. uname26 utmpdump uuidd uuidparse wall wdctl whereis wipefs
  1131. i386 x86_64 zramctl)</li>
  1132. </ul>
  1133. <p>Commentary: toybox init doesn't do runlevels, man and vim are just the
  1134. relevant commands without the piles of strange overgrowth, and if you want
  1135. to call a toybox binary by another name you can create a symlink to a
  1136. symlink. If somebody really wants to argue for "gzexe" or similar, be
  1137. my guest, but there's a lot of obsolete crap in shadow, coreutils,
  1138. util-linux...</p>
  1139. <p>No idea why LFS is installing inetutils instead of net-tools
  1140. (which contains arp route ifconfig mii-tool nameif netstat and rarp that
  1141. toybox does or might implement, and plipconfig slattach that it probably won't.)</p>
  1142. <h3>Packages toybox plans to provide partial replacements for:</h3>
  1143. <p>Toybox provides replacements for some binaries from these packages,
  1144. but there are other useful binaries which this package provides that toybox
  1145. currently considers out of scope for the project:</p>
  1146. <ul>
  1147. <li><b>binutils</b>: strings [ar] [nm] [readelf] [size] [objcopy] [strip]
  1148. (not c++filt, dwp, elfedit, gprof. The following commands belong
  1149. in <a href=/code/qcc>qcc</a>: addr2line as ld objdump ranlib)</li>
  1150. <li><b>bzip2</b>: bunzip2 bzcat [bzcmp] [bzdiff] [bzegrep] [bzfgrep] [bzgrep] [bzless]
  1151. [bzmore] (not: bzip2, bzip2recover, see also libbz2)</li>
  1152. <li><b>xz</b>: [xzcat] [lzcat] [lzcmp] [lzdiff] [lzegrep] [lzfgrep] [lzgrep]
  1153. [lzless] [lzmadec, lzmainfo] [lzmore] [unlzma] [unxz] [xzcat]
  1154. [xzcmp] [xzdec] [xzdiff] [xzegrep] [xzfgrep] [xzgrep] [xzless] [xzmore]
  1155. (not: compression side, see also: liblzma)</li>
  1156. <li><b>ncurses</b>: clear reset (not: everything else, see also: libcurses)</li>
  1157. <li><b>e2fsprogs</b>: chattr lsattr [e2fsck] [mkfs.ext2] [mkfs.ext3]
  1158. [fsck.ext2] [fsck.ext3] [e2label] [resize2fs] [tune2fs]
  1159. (not badblocks compile_et debugfs dumpe2fse2freefrag e2image
  1160. e2mmpstatus e2scrub e2scrub_all e2undo e4crypt e4defrag filefrag
  1161. fsck.ext4 logsave mk_cmds mkfs.ext4 mklost+found)</li>
  1162. </ul>
  1163. <p>Toybox provides several decompressors but compresses to a single format
  1164. (deflate, ala gzip/zlib). Our e2fsprogs doesn't currently plan to support
  1165. ext4 or defrag. The "qcc" reference is because someday an external project to glue
  1166. QEMU's <a href=https://git.qemu.org/?p=qemu.git;a=blob;f=tcg/README;h=bfa2e4ed246c;hb=HEAD>Tiny Code Generator</a>
  1167. to Fabrice Bellard's old <a href=http://landley.net/hg/tinycc>Tiny C Compiler</a>
  1168. making a multicall binary that does cc/ld/as for all the targets QEMU
  1169. supports (then use the
  1170. <a href=https://github.com/JuliaComputing/llvm-cbe>LLVM C Backend</a>
  1171. to compile LLVM itself to C for use as a modern replacement for
  1172. <a href=https://en.wikipedia.org/wiki/Cfront>cfront</a> to bootstrap
  1173. C++ code) is under consideration
  1174. as a successor project to toybox. Until then things like objdump -d
  1175. (requiring target-specific disassembly for an unbounded number of architectures)
  1176. are out of scope for toybox. (This means drawing the line somewhere between
  1177. architecture-specific support in file and strace, and including a full
  1178. assembler for each architecture.)</p>
  1179. </span>
  1180. <h3>Packages from LFS ch6 toybox does NOT plan to replace:</h3>
  1181. <ul>
  1182. <li><b>linux-api-headers</b></li>
  1183. <li><b>man-pages glibc</b></li>
  1184. <li><b>zlib</b></li>
  1185. <li><b>readline</b></li>
  1186. <li><b>gmp</b></li>
  1187. <li><b>mpfr</b></li>
  1188. <li><b>mpc</b></li>
  1189. <li><b>gcc</b></li>
  1190. <li><b>pkg-config</b></li>
  1191. <li><b>ncurses</b></li>
  1192. <li><b>acl</b></li>
  1193. <li><b>libcap</b></li>
  1194. <li><b>psmisc</b></li>
  1195. <li><b>iana-etc</b></li>
  1196. <li><b>libtool</b></li>
  1197. <li><b>gdbm</b></li>
  1198. <li><b>gperf</b></li>
  1199. <li><b>expat</b></li>
  1200. <li><b>perl</b></li>
  1201. <li><b>XML::Parser</b></li>
  1202. <li><b>intltool</b></li>
  1203. <li><b>autoconf</b></li>
  1204. <li><b>automake</b></li>
  1205. <li><b>gettext</b></li>
  1206. <li><b>libelf</b></li>
  1207. <li><b>libffi</b></li>
  1208. <li><b>openssl</b></li>
  1209. <li><b>python</b></li>
  1210. <li><b>ninja</b></li>
  1211. <li><b>meson</b></li>
  1212. <li><b>check</b></li>
  1213. <li><b>groff</b></li>
  1214. <li><b>grub</b></li>
  1215. <li><b>libpipeline</b></li>
  1216. <li><b>texinfo</b></li>
  1217. </ul>
  1218. <p>That said, we do implement our own zlib and readline replacements, and
  1219. presumably _could_ export them as library bindings. Plus we provide
  1220. our own version of a bunch of the section 1 man pages (as command help).
  1221. Possibly libcap and acl are interesting?</p>
  1222. <h3>Misc</h3>
  1223. <p>The kbd package has over a dozen commands, we only implement chvt. The
  1224. iproute2 package implements over a dozen commands, there's an "ip" in
  1225. pending but I'm not a fan (ifconfig and route and such should be extended
  1226. to work properly). We don't implement eudev, but toybox's maintainer
  1227. created busybox mdev way back when (which replaces it) and plans to do a
  1228. new one for toybox as soon as we work out what subset is still needed now that
  1229. devtmpfs is available.</p>
  1230. <!-- #include "footer.html" -->