Bootstrapping

In general, bootstrapping usually refers to a self-starting process that is supposed to continue or grow without external input. Many analytical techniques are often called bootstrap methods in reference to their self-starting or self-supporting implementation, such as bootstrapping (statistics), bootstrapping (finance), or bootstrapping (linguistics).

Etymology

Tall boots may have a tab, loop or handle at the top known as a bootstrap, allowing one to use fingers or a boot hook tool to help pull the boots on. The saying "to pull oneself up by one's bootstraps"^[1] was already in use during the 19th century as an example of an impossible task. The idiom dates at least to 1834, when it appeared in the Workingman's Advocate: "It is conjectured that Mr. Murphee will now be enabled to hand himself over the Cumberland river or a barn yard fence by the straps of his boots."^[2] In 1860 it appeared in a comment on philosophy of mind: "The attempt of the mind to analyze itself [is] an effort analogous to one who would lift himself by his own bootstraps."^[3] Bootstrap as a metaphor, meaning to better oneself by one's own unaided efforts, was in use in 1922.^[4] This metaphor spawned additional metaphors for a series of self-sustaining processes that proceed without external help.^[5]

The term is sometimes attributed to a story in Rudolf Erich Raspe's The Surprising Adventures of Baron Munchausen, but in that story Baron Munchausen pulls himself (and his horse) out of a swamp by his hair (specifically, his pigtail), not by his bootstraps – and no explicit reference to bootstraps has been found elsewhere in the various versions of the Munchausen tales.^[2]

Originally meant to attempt something ludicrously far-fetched or even impossible, the phrase "Pull yourself up by your bootstraps!" has since been utilized as a narrative for economic mobility or a cure for depression. That idea is believed to have been popularized by American writer Horatio Alger in the 19th century.^[6] To request that someone "bootstrap" is to suggest that they might overcome great difficulty by sheer force of will.^[7]

Critics have observed that the phrase is used to portray unfair situations as far more meritocratic than they really are.^[8]^[9]^[7] A 2009 study found that 77% of Americans believe that wealth is often the result of hard work.^[10] Various studies have found that the main predictor of future wealth is not IQ or hard work, but initial wealth.^[7]^[11]

Applications

Computing

In computer technology, the term bootstrapping refers to language compilers that are able to be coded in the same language. (For example, a C compiler is now written in the C language. Once the basic compiler is written, improvements can be iteratively made, thus pulling the language up by its bootstraps). Also, booting usually refers to the process of loading the basic software into the memory of a computer after power-on or general reset, the kernel will load the operating system which will then take care of loading other device drivers and software as needed.

Software loading and execution

Booting is the process of starting a computer, specifically with regard to starting its software. The process involves a chain of stages, in which at each stage, a relatively small and simple program loads and then executes the larger, more complicated program of the next stage. It is in this sense that the computer "pulls itself up by its bootstraps"; i.e., it improves itself by its own efforts. Booting is a chain of events that starts with execution of hardware-based procedures and may then hand off to firmware and software which is loaded into main memory. Booting often involves processes such as performing self-tests, loading configuration settings, loading a BIOS, resident monitors, a hypervisor, an operating system, or utility software.

The computer term bootstrap began as a metaphor in the 1950s. In computers, pressing a bootstrap button caused a hardwired program to read a bootstrap program from an input unit. The computer would then execute the bootstrap program, which caused it to read more program instructions. It became a self-sustaining process that proceeded without external help from manually entered instructions. As a computing term, bootstrap has been used since at least 1953.^[12]

Software development

Bootstrapping can also refer to the development of successively more complex, faster programming environments. The simplest environment will be, perhaps, a very basic text editor (e.g., ed) and an assembler program. Using these tools, one can write a more complex text editor, and a simple compiler for a higher-level language and so on, until one can have a graphical IDE and an extremely high-level programming language.

Historically, bootstrapping also refers to an early technique for computer program development on new hardware. The technique described in this paragraph has been replaced by the use of a cross compiler executed by a pre-existing computer. Bootstrapping in program development began during the 1950s when each program was constructed on paper in decimal code or in binary code, bit by bit (1s and 0s), because there was no high-level computer language, no compiler, no assembler, and no linker. A tiny assembler program was hand-coded for a new computer (for example the IBM 650) which converted a few instructions into binary or decimal code: A1. This simple assembler program was then rewritten in its just-defined assembly language but with extensions that would enable the use of some additional mnemonics for more complex operation codes. The enhanced assembler's source program was then assembled by its predecessor's executable (A1) into binary or decimal code to give A2, and the cycle repeated (now with those enhancements available), until the entire instruction set was coded, branch addresses were automatically calculated, and other conveniences (such as conditional assembly, macros, optimisations, etc.) established. This was how the early Symbolic Optimal Assembly Program (SOAP) was developed. Compilers, linkers, loaders, and utilities were then coded in assembly language, further continuing the bootstrapping process of developing complex software systems by using simpler software.

The term was also championed by Doug Engelbart to refer to his belief that organizations could better evolve by improving the process they use for improvement (thus obtaining a compounding effect over time). His SRI team that developed the NLS hypertext system applied this strategy by using the tool they had developed to improve the tool.

Compilers

The development of compilers for new programming languages first developed in an existing language but then rewritten in the new language and compiled by itself, is another example of the bootstrapping notion.

Installers

During the installation of computer programs, it is sometimes necessary to update the installer or package manager itself. The common pattern for this is to use a small executable bootstrapper file (e.g., setup.exe) which updates the installer and starts the real installation after the update. Sometimes the bootstrapper also installs other prerequisites for the software during the bootstrapping process.

Overlay networks

A bootstrapping node, also known as a rendezvous host,^[13] is a node in an overlay network that provides initial configuration information to newly joining nodes so that they may successfully join the overlay network.^[14]^[15]

Discrete-event simulation

A type of computer simulation called discrete-event simulation represents the operation of a system as a chronological sequence of events. A technique called bootstrapping the simulation model is used, which bootstraps initial data points using a pseudorandom number generator to schedule an initial set of pending events, which schedule additional events, and with time, the distribution of event times approaches its steady state—the bootstrapping behavior is overwhelmed by steady-state behavior.

Artificial intelligence and machine learning

Bootstrapping is a technique used to iteratively improve a classifier's performance. Typically, multiple classifiers will be trained on different sets of the input data, and on prediction tasks the output of the different classifiers will be combined.

Seed AI is a hypothesized type of artificial intelligence capable of recursive self-improvement. Having improved itself, it would become better at improving itself, potentially leading to an exponential increase in intelligence. No such AI is known to exist, but it remains an active field of research. Seed AI is a significant part of some theories about the technological singularity: proponents believe that the development of seed AI will rapidly yield ever-smarter intelligence (via bootstrapping) and thus a new era.^[16]^[17]

Statistics

Bootstrapping is a resampling technique used to obtain estimates of summary statistics.

Business

Bootstrapping in business means starting a business without external help or working capital. Entrepreneurs in the startup development phase of their company survive through internal cash flow and are very cautious with their expenses.^[18] Generally at the start of a venture, a small amount of money will be set aside for the bootstrap process.^[19] Bootstrapping can also be a supplement for econometric models.^[20] Bootstrapping was also expanded upon in the book Bootstrap Business by Richard Christiansen, the Harvard Business Review article The Art of Bootstrapping and the follow-up book The Origin and Evolution of New Businesses by Amar Bhide. There is also an entire bible written on how to properly bootstrap by Seth Godin.

Experts have noted that several common stages exist for bootstrapping a business venture:

Birth-stage: This is the first stage to bootstrapping by which the entrepreneur utilizes any personal savings or borrowed and/or invested money from friends and family to launch the business. It is also possible for the business owner to be running or working for another organization at the time which may help to fuel their business and cover initial expenses.
Funding from sales to consumers-stage: In this particular stage, money from customers is used to keep the business operating afloat. Once expenses caused by normal day-to-day business operations are met, the rate growth usually increases.
Outsourcing-stage: At this point in the company's existence, the entrepreneur in question normally concentrates on the specific operating activities. This is the time in which entrepreneurs decide how to improve and upgrade equipment (subsequently increasing output) or even employing new staff members. At this point in time, the company may seek loans or even lean on other methods of additional funding such as venture capital to help with expansion and other improvements.^[21]

There are many types of companies that are eligible for bootstrapping. Early-stage companies that do not necessarily require large influxes of capital (particularly from outside sources) qualify. This would specifically allow for flexibility for the business and time to grow. Serial entrepreneur companies could also possibly reap the benefits of bootstrapping. These are organizations whereby the founder has money from the sale of a previous companies they can use to invest.^[21]

There are different methods of bootstrapping. Future business owners aspiring to use bootstrapping as way of launching their product or service often use the following methods:

Using accessible money from their own personal savings.
Managing their working capital in a way that minimizes their company's accounts receivable.
Cashing out 401k retirement funds and pay them off at later dates.
Gradually increasing the business' accounts payable through delaying payments or even renting equipment instead of buying them.

Bootstrapping is often considered successful. When taking into account statistics provided by Fundera, approximately 77% of small business rely on some sort of personal investment and or savings in order to fund their startup ventures. The average small business venture requires approximately $10,000 in startup capital with a third of small business launching with less than $5,000 bootstrapped.

Based on startup data presented by Entrepreneur.com, in comparison other methods of funding, bootstrapping is more commonly used than others. "0.91% of startups are funded by angel investors, while 0.05% are funded by VCs. In contrast, 57 percent of startups are funded by personal loans and credit, while 38 percent receive funding from family and friends."^[22]

Some examples of successful entrepreneurs that have used bootstrapping in order to finance their businesses include serial entrepreneur Mark Cuban. He has publicly endorsed bootstrapping claiming that "If you can start on your own … do it by [yourself] without having to go out and raise money." When asked why he believed this approach was most necessary, he replied, "I think the biggest mistake people make is once they have an idea and the goal of starting a business, they think they have to raise money. And once you raise money, that's not an accomplishment, that's an obligation" because "now, you're reporting to whoever you raised money from."^[23]

Bootstrapped companies such as Apple Inc. (APPL), eBay Inc. (EBAY) and Coca-Cola Co.^[21] have also claimed that they attribute some of their success to the fact that this method of funding enables them to remain highly focused on a specific array of profitable product.

Startups can grow by reinvesting profits in its own growth if bootstrapping costs are low and return on investment is high. This financing approach allows owners to maintain control of their business and forces them to spend with discipline.^[24] In addition, bootstrapping allows startups to focus on customers rather than investors, thereby increasing the likelihood of creating a profitable business. This leaves startups with a better exit strategy with greater returns.

Leveraged buyouts, or highly leveraged or "bootstrap" transactions, occur when an investor acquires a controlling interest in a company's equity and where a significant percentage of the purchase price is financed through leverage, i.e. borrowing by the acquired company.

Bootstrapping in finance refers to the method to create the spot rate curve. Operation Bootstrap (Operación Manos a la Obra) refers to the ambitious projects that industrialized Puerto Rico in the mid-20th century.

Biology

Richard Dawkins in his book River Out of Eden^[25] used the computer bootstrapping concept to explain how biological cells differentiate: "Different cells receive different combinations of chemicals, which switch on different combinations of genes, and some genes work to switch other genes on or off. And so the bootstrapping continues, until we have the full repertoire of different kinds of cells."

Phylogenetics

Bootstrapping analysis gives a way to judge the strength of support for clades on phylogenetic trees. A number is written by a node, which reflects the percentage of bootstrap trees which also resolve the clade at the endpoints of that branch.^[26]

Law

Bootstrapping is a rule preventing the admission of hearsay evidence in conspiracy cases.

Linguistics

Bootstrapping is a theory of language acquisition.

Physics

Quantum theory

Bootstrapping is using very general consistency criteria to determine the form of a quantum theory from some assumptions on the spectrum of particles or operators.

Magnetically confined fusion plasmas

In tokamak fusion devices, bootstrapping refers to the process in which a bootstrap current is self-generated by the plasma, which reduces or eliminates the need for an external current driver. Maximising the bootstrap current is a major goal of advanced tokamak designs.

Inertially confined fusion plasmas

Bootstrapping in inertial confinement fusion refers to the alpha particles produced in the fusion reaction providing further heating to the plasma. This heating leads to ignition and an overall energy gain.

Electronics

Bootstrapping is a form of positive feedback in analog circuit design.

Electric power grid

An electric power grid is almost never brought down intentionally. Generators and power stations are started and shut down as necessary. A typical power station requires power for start up prior to being able to generate power. This power is obtained from the grid, so if the entire grid is down these stations cannot be started.

Therefore, to get a grid started, there must be at least a small number of power stations that can start entirely on their own. A black start is the process of restoring a power station to operation without relying on external power. In the absence of grid power, one or more black starts are used to bootstrap the grid.

Nuclear power

A nuclear power plant always needs to have a way to remove decay heat, which is usually done with electrical cooling pumps. But in the rare case of a complete loss of electrical power, this can still be achieved by booting a turbine generator. As steam builds up in the steam generator, it can be used to power the turbine generator (initially with no oil pumps, circ water pumps, or condensation pumps). Once the turbine generator is producing electricity, the auxiliary pumps can be powered on, and the reactor cooling pumps can be run momentarily. Eventually the steam pressure will become insufficient to power the turbine generator, and the process can be shut down in reverse order. The process can be repeated until no longer needed. This can cause great damage to the turbine generator, but more importantly, it saves the nuclear reactor.

Cellular networks

A Bootstrapping Server Function (BSF) is an intermediary element in cellular networks which provides application independent functions for mutual authentication of user equipment and servers unknown to each other and for 'bootstrapping' the exchange of secret session keys afterwards. The term 'bootstrapping' is related to building a security relation with a previously unknown device first and to allow installing security elements (keys) in the device and the BSF afterwards.

References

^ "figurative 'bootstraps'" (Mailing list). 2005-08-11.
^ ^a ^b Jan Freeman, Bootstraps and Baron Munchausen, Boston.com, January 27, 2009
^ Jan Freeman, The unkindliest cut, Boston.com, January 25, 2009
^ Ulysses cited in the Oxford English Dictionary
^ Martin, Gary. "'Pull yourself up by your bootstraps' - the meaning and origin of this phrase". Phrasefinder. Retrieved 23 June 2018.
^ Williams, Mary Elizabeth (2023-04-01). ""Pull yourself up by your bootstraps:" How a joke about bootstraps devolved into an American credo". Salon. Retrieved 2023-11-09.
^ ^a ^b ^c "The myth of meritocracy". BPS. Retrieved 2023-11-09.
^ "Why The Phrase 'Pull Yourself Up By Your Bootstraps' Is Nonsense". HuffPost UK. 2018-08-09. Retrieved 2023-11-09.
^ Kristof, Nicholas (2020-02-20). "Opinion | Pull Yourself Up by Bootstraps? Go Ahead, Try It". The New York Times. ISSN 0362-4331. Retrieved 2023-11-09.
^ Alvarado, Lorriz Anne (2010). "Dispelling the Meritocracy Myth: Lessons for Higher Education and Student Affairs Educatorsand Student Affairs Educators".
^ Massey, Douglas S.; Charles, Camille Z.; Lundy, Garvey; Fischer, Mary J. (2011-06-27). The Source of the River: The Social Origins of Freshmen at America's Selective Colleges and Universities. Princeton University Press. ISBN 978-1-4008-4076-2.
^ Buchholz, Werner (1953). "The System Design of the IBM Type 701 Computer". Proceedings of the I.R.E. 41 (10): 1273. doi:10.1109/jrproc.1953.274300. S2CID 51673999.
^ Francis, Paul (2000-04-02). "Yoid: Extending the Internet Multicast Architecture" (PDF). www.aciri.org. Archived (PDF) from the original on 2022-10-09. Retrieved 2008-12-24. {{cite journal}}: Cite journal requires |journal= (help)
^ Traversat; et al. (2006-06-20). "US Patent 7,065,579". Retrieved 2008-12-23.
^ Saxena; et al. (2003). "Admission Control in Peer-to-Peer: Design and Performance Evaluation" (PDF). In ACM Workshop on Security of Ad Hoc and Sensor Networks (SASN) 2003. Archived (PDF) from the original on 2022-10-09. Retrieved 2008-12-24. {{cite journal}}: Cite journal requires |journal= (help)
^ Cortese, Francesco Albert Bosco (Spring 2014). "The Maximally Distributed Intelligence Explosion". AAAI Spring Symposium. Archived from the original on 2021-04-13. Retrieved 2018-07-01.
^ Waser, Mark R. (2014). "Bootstrapping a Structured Self-Improving & Safe Autopoietic Self". Procedia Computer Science. 41: 134–139. doi:10.1016/j.procs.2014.11.095.
^ "The art of the bootstrap". 21 November 2008. Retrieved 23 June 2018.
^ Godin, Seth. "The Bootstrap Bible" (PDF). Archived (PDF) from the original on 2022-10-09. Retrieved 23 June 2018.
^ J. Scott Armstrong (2001). "Judgmental Bootstrapping: Inferring Experts= Rules for Forecasting" (PDF). Principles of Forecasting: A Handbook for Researchers and Practitioners. Kluwer Academic Publishers. Archived from the original (PDF) on 2010-06-20. Retrieved 2012-01-10.
^ ^a ^b ^c Harvey, Ian. "Companies That Succeeded With Bootstrapping". Investopedia. Retrieved 2020-12-18.
^ Entis, Laura (2013-11-20). "Where Startup Funding Really Comes From (Infographic)". Entrepreneur. Retrieved 2020-12-18.
^ Huddleston, Tom Jr. (2019-10-11). "Mark Cuban: This is the 'biggest mistake' people make when starting a business". CNBC. Retrieved 2020-12-18.
^ Ulrich, Karl (10 February 2014). "Bootstrapping in Entrepreneurship - Karl T. Ulrich". Retrieved 23 June 2018 – via Vimeo.
^ Richard Dawkins, River Out of Eden, pages 23-25, 1995 (paper) ISBN 0-465-06990-8
^ Bradley Efron; Elizabeth Halloran & Susan Holmes (1996). "Bootstrap confidence levels for phylogenetic trees". PNAS. 93 (23): 7085–90. doi:10.1073/pnas.93.23.13429. PMC 38940. PMID 8692949.

External links

[examples-1] "figurative 'bootstraps'" (Mailing list). 2005-08-11.

[Freeman1-2] Jan Freeman, Bootstraps and Baron Munchausen, Boston.com, January 27, 2009

[3] Jan Freeman, The unkindliest cut, Boston.com, January 25, 2009

[4] Ulysses cited in the Oxford English Dictionary

[5] Martin, Gary. "'Pull yourself up by your bootstraps' - the meaning and origin of this phrase". Phrasefinder. Retrieved 23 June 2018.

[6] Williams, Mary Elizabeth (2023-04-01). ""Pull yourself up by your bootstraps:" How a joke about bootstraps devolved into an American credo". Salon. Retrieved 2023-11-09.

[:1-7] "The myth of meritocracy". BPS. Retrieved 2023-11-09.

[8] "Why The Phrase 'Pull Yourself Up By Your Bootstraps' Is Nonsense". HuffPost UK. 2018-08-09. Retrieved 2023-11-09.

[9] Kristof, Nicholas (2020-02-20). "Opinion | Pull Yourself Up by Bootstraps? Go Ahead, Try It". The New York Times. ISSN 0362-4331. Retrieved 2023-11-09.

[10] Alvarado, Lorriz Anne (2010). "Dispelling the Meritocracy Myth: Lessons for Higher Education and Student Affairs Educatorsand Student Affairs Educators".

[11] Massey, Douglas S.; Charles, Camille Z.; Lundy, Garvey; Fischer, Mary J. (2011-06-27). The Source of the River: The Social Origins of Freshmen at America's Selective Colleges and Universities. Princeton University Press. ISBN 978-1-4008-4076-2.

[12] Buchholz, Werner (1953). "The System Design of the IBM Type 701 Computer". Proceedings of the I.R.E. 41 (10): 1273. doi:10.1109/jrproc.1953.274300. S2CID 51673999.

[Francis01-13] Francis, Paul (2000-04-02). "Yoid: Extending the Internet Multicast Architecture" (PDF). www.aciri.org. Archived (PDF) from the original on 2022-10-09. Retrieved 2008-12-24. {{cite journal}}: Cite journal requires |journal= (help)

[sun01-14] Traversat; et al. (2006-06-20). "US Patent 7,065,579". Retrieved 2008-12-23.

[Saxena01-15] Saxena; et al. (2003). "Admission Control in Peer-to-Peer: Design and Performance Evaluation" (PDF). In ACM Workshop on Security of Ad Hoc and Sensor Networks (SASN) 2003. Archived (PDF) from the original on 2022-10-09. Retrieved 2008-12-24. {{cite journal}}: Cite journal requires |journal= (help)

[16] Cortese, Francesco Albert Bosco (Spring 2014). "The Maximally Distributed Intelligence Explosion". AAAI Spring Symposium. Archived from the original on 2021-04-13. Retrieved 2018-07-01.

[17] Waser, Mark R. (2014). "Bootstrapping a Structured Self-Improving & Safe Autopoietic Self". Procedia Computer Science. 41: 134–139. doi:10.1016/j.procs.2014.11.095.

[18] "The art of the bootstrap". 21 November 2008. Retrieved 23 June 2018.

[Bootstrap-19] Godin, Seth. "The Bootstrap Bible" (PDF). Archived (PDF) from the original on 2022-10-09. Retrieved 23 June 2018.

[20] J. Scott Armstrong (2001). "Judgmental Bootstrapping: Inferring Experts= Rules for Forecasting" (PDF). Principles of Forecasting: A Handbook for Researchers and Practitioners. Kluwer Academic Publishers. Archived from the original (PDF) on 2010-06-20. Retrieved 2012-01-10.

[:0-21] Harvey, Ian. "Companies That Succeeded With Bootstrapping". Investopedia. Retrieved 2020-12-18.

[22] Entis, Laura (2013-11-20). "Where Startup Funding Really Comes From (Infographic)". Entrepreneur. Retrieved 2020-12-18.

[23] Huddleston, Tom Jr. (2019-10-11). "Mark Cuban: This is the 'biggest mistake' people make when starting a business". CNBC. Retrieved 2020-12-18.

[24] Ulrich, Karl (10 February 2014). "Bootstrapping in Entrepreneurship - Karl T. Ulrich". Retrieved 23 June 2018 – via Vimeo.

[25] Richard Dawkins, River Out of Eden, pages 23-25, 1995 (paper) ISBN 0-465-06990-8

[26] Bradley Efron; Elizabeth Halloran & Susan Holmes (1996). "Bootstrap confidence levels for phylogenetic trees". PNAS. 93 (23): 7085–90. doi:10.1073/pnas.93.23.13429. PMC 38940. PMID 8692949.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

[13]

[14]

[15]

[16]

[17]

[18]

[19]

[20]

[21]

[22]

[23]

[24]

[25]

[26]