Read time: 13 minutes
We are currently witnessing the onset of a new paradigm that is going to revolutionize in a fundamental way the Science, Engineering, and Technology of tomorrow. This paradigm implies the consolidated use of theory, experimentation, and simulation, and is driven by the availability of extremely large amounts of data generated as a result of great technological innovations.
Nature does not fit itself very well into the rigorous constraints imposed by Math, Physics or Computer Engineering. But instead, the natural world juggles between disciplinary boundaries to achieve its main objectives – survival and evolution.
As the general body of knowledge is becoming ever more complex, so does the requirement for a higher threshold of scientific competence and greater interdisciplinarity among researchers and practitioners. This article will bring to the attention of the reader the emergence of a new engineering discipline that, in my opinion, is going to have a powerful impact not only on the future of the financial industry but more generally on any other sectors of the modern economy.
1. The Problem
The global markets for talent recruiting and management are extremely large, estimated at about $250-300B annually. Their identified inefficiencies are so large in scope and so critical to the success of the next industrial revolution, that they require the adoption of a revolutionary new paradigm-shifting the emphasis from content acquisition to experiential learning at a very accelerated pace.
Educating the 21st-century hi-tech workforce will require a brand new approach, one that is more relevant, modern and efficient, for both the employers and their current and future workforce.
By integrating a variety of quantitative, computational and life science approaches, this new engineering discipline is called to break the barriers that keep us from reaching the AI-dream, having as principal objective to enhance human life.
2. Solution Drivers
2.1 The Great Convergence
Because the quant space has become so much more competitive, the recruiting process has also changed accordingly. The interviewing process is a lot more challenging, requiring better preparation and a lot of stamina to be able to cope with the load and the complexity of the tests required.
2.2 Rigor and Practicality
Based on the data collected via observations, a hypothesis is then constructed and tested via experimentation. Since generality is always desirable, the reproducibility of results is tested under varied conditions.
The art of asking the right questions is a critical phase of the creativity process. In general three classes of questions are posed: the WHAT (objective), the WHY (causality or correlation) and the HOW (implementation). Business generally deals with planning and prioritization (the WHAT), Science offers the proper set of methods and techniques for solving the problem at hand from a theoretical perspective (the WHY), while Engineering provides the tools and processes to implement a practical solution (the HOW). This division of roles is going to get a lot fuzzier in the very near future, as the engineer of the 21st century will have to perform many of these tasks in rapid succession.
In the newly emerging paradigm of technological development, theory, experimentation, and simulation are used in a consolidated fashion to solve the kind of difficult practical problems that could not have found solutions until very recently [1]. An unintended consequence of this new paradigm is represented by the hype surrounding the so-called Artificial Intelligence revolution.
The term AI has become the mantra of our time as this label is used more and more frequently as an intellectual wildcard by academicians and practitioners alike. History showed as quite common the fact that a certain level of misunderstanding surrounds novel technology concepts when they are leaving the research labs and are crossing into the public domain.
The current AI-hype comes down to the idea that we are living in an era where the emergence of in-silico intelligence could compete with human intelligence. This is very misleading indeed and actually quite untrue. The success of this new engineering discipline will depend very much on whether or not we will be able to clarify the AI terminology and to adjust the expectations accordingly. Whether or not Science will be able any time soon to understand and properly model the concept of Intelligence, enrolling both computers and humans into the fight to enhance human life is a major challenge ahead!
Solving the challenge of understanding General Intelligence will be quintessential to the development of AI, and this new branch of engineering may be the catalyst for it. Like many other classic branches of engineering that emerged in the past (i.e. Civil, Mechanical, Electrical or Chemical), this new engineering discipline is going to be built on already mature concepts such as information, data, algorithm, computing, evolution, and optimization. Some may already have a name for this new discipline - Data Science.
However, in my opinion, this view is an oversimplified one, since there are a lot more components associated with this emerging discipline than just data.
No matter the label used, this new field will be focused on leveraging large amounts of data, intensive computations, and scientific knowledge to ultimately enhance human life. Therefore its development will require perspectives from a variety of disciplines: from quantitative sciences, like Mathematics and Statistics, to life sciences like Biology and Psychology, and from Computational Sciences to Engineering and Business.
2.3 Opportunities
There is a healthy competition between the science of Computational Intelligence, which is attempting to understand the principles of reasoning, and the engineering of Computational Intelligence, which focuses on coding the programs required to solve particular problems.
This duality is one of the main drivers of this discipline. The field of Computational Intelligence is aiming at the creation and testing of complex theories, specifically looking at how difficult practical problems could be represented and solved by a computer. These theories should have empirical support in real-world implementations, whose quality should be judged by traditional Computer Science principles. The main purpose of Computational Intelligence is to bridge the duality of specifying theories and building implementations [3].
3. Tools versus Problems
If the use of an exhaustive toolset is providing the solution architect with horizontal scalability, mastering the expertise of what tools to be used for any given problem will grant the user the vertical scalability that is absolutely necessary for implementing intelligent solutions. The relevance of this new breed of engineering for the financial industry resides on its practicality and in the primacy of developing problem-solving skills over the mastering of ephemeral tools.
4. A New Engineering Discipline
Technology companies in general, and trading and asset management firms in particular need to gain the ability to have a quantifiable measure of the in-house resident knowledge, as well as a framework of well-defined metrics to be used in the recruiting process to seamlessly match business needs to talent.
Financial firms are looking for candidates that are mastering an ever-increasing set of tools, from Financial Mathematics to Computer Science, from Big Data Analytics to Machine Learning and from Blockchain to Quantum Computing technology. But no matter how extensive is the toolset, what they are especially looking for, is the ability of candidates to solve practical problems.
This brave new world will require a new breed of engineering workforce: one combining classical quantitative skills with deep knowledge of Computer Science and hands-on knowledge of modern HPC technologies. Since the central objective is Innovation, fluency in the triad Science-Engineering-Technology is a hard-core prerequisite that requires engaging in a life-long cycle of learning.
This new engineering discipline will be very different from all its predecessors because it will be Data-driven, Computationally-intensive, Biology-inspired, and Human-centered at the same time.
5. Conclusions
Realistically, what kind of engineers is going to be able to carry on this work to create intelligent machines that could replicate themselves? Or even more realistically, how are business decision-makers going to select the right tools for their given problems? Such a bold disruption at a planetary scale will require novel approaches to educate the future workforce and to train the existing personnel.
Until such disruptive scientific and technological breakthroughs will occur, the best course of action is to continue to make steady progress on automating some of the most complex tasks at hand and to devise new ways of learning from data by using the computational toolset already available. At the same time, our economy will need to redirect its focus on the education process of the future workforce, and this will require mastering ever more complex tools and frameworks, and especially the development of solid and scalable problem-solving skills.
I will conclude outlining my own view on the mission of this new engineering discipline: nurture an innovative Engineering Mind that is driven by a powerful Mathematical Engine, supported by a vigorous Research Impetus and guided by strong Technology expertise. All of these components will need to coexist and to be nourished with up-to-date knowledge in order to properly develop the new breed of an engineer of the 21st century.
This new profession will represent a significant evolution in respect to the quant of the 20th century, as it will address the needs of the modern economy by making itself available to a variety of industries, way beyond the realm of the Finance. Fields like Medicine, Healthcare, Education and the Internet-of-Things are going to be big consumers of this novel specialty. Since the modern society is so immersed and dependent on data and the methods to extract actionable information from it, this new breed of engineers will position themselves at the core of the system that drives the most important business decisions.
Let’s be realistic and accept the fact that humanity’s most valuable asset is human Intelligence! Today our most important objective as quant educators is to kindle the interest in innovation and to nurture the problem-solving skills of our students.
The expectation is that this new engineering discipline will fulfill a very important societal role in facilitating the success of the next industrial revolution!
6. References
[1] Jim Grey on eScience: A Transformed Scientific Method, In Tony Hey, Stewart Tansley, and Kristin Tolle (Eds.) The Fourth Paradigm: Data-Intensive Scientific Discovery, Microsoft Research, 2009. Content available at: http://itre.cis.upenn.edu/myl/JimGrayOnE-Science.pdf
[2] J. Wing: Computational Thinking published in Comm. ACM, vol. 49, no. 3, 2006
[3] C. Doloc: Applications of Computational Intelligence in Data-Driven Trading, Wiley, 2019
[4] R. Kurzweil: The Singularity is Near: When Humans Transcend Biology, Viking Press, 2005
→ If you enjoyed reading this blog article, check Cris Doloc's previous article entitled: "Defining Learning in the context of Artificial Intelligence".