A state of AI in 2024
Tags: ai, genai, llm, cloud
Published: 2024-07-15 14:00:00

If I tell you that about 2 years ago, [GenAI](https://en.wikipedia.org/wiki/Generative_artificial_intelligence) arrived with [ChatGPT](https://openai.com/chatgpt/) and that now we almost only hear about Artificial Intelligence, in every way, I probably don't tell you much.

I would therefore like, in this article, to bring clarity to the subject, by summarizing the implications of AI today, what are the current issues that we are facing, but also, the concrete and useful applications from which we can benefit.

# An abstract definition

AI (Articial Intelligence) is a field of computer science that focuses on creating systems capable of performing tasks that typically require human intelligence. These tasks include learning from experience, recognizing patterns, solving problems, understanding natural language and making decisions.

Pay attention to one thing, it is important to realize that this is a very generic expression and that it is nothing more or less about computer, algorithmic techniques which are actually used, far from replacing the functioning of a human brain.

In other words, what we call “AI” depends entirely on our perception of it, and should rather be called “algorithmic techniques”. So much so that Luc Julia, who created Siri, came to say that “[There is no such thing as AI](https://www.youtube.com/watch?v=6prCHASkavM)”.

# A technical definition

Systems commonly associated to AI are designed to learn from data, adapt to new inputs, and improve over time. This key components and subfields include :

- **Machine Learning (ML)**: A subset of AI that involves training algorithms to recognize patterns and make decisions based on data. ML models are built using statistical techniques to enable systems to improve their performance on a given task with more data over time.
- **Deep Learning (DL)**: A specialized branch of ML that employs neural networks with many layers (hence "deep") to model complex patterns in large datasets. DL is particularly effective in tasks such as image and speech recognition.
- **Large Language Models (LLMs)**: These are deep learning models that are trained on vast amounts of text data to understand and generate human language. Examples include GPT (Generative Pre-trained Transformer) and BERT (Bidirectional Encoder Representations from Transformers).
- **Generative AI (GenAI)**: A type of AI focused on creating new content, such as text, images, or music, that is indistinguishable from human-generated content. This includes techniques like Generative Adversarial Networks (GANs) and autoregressive models like GPT.
- **Retrieval-Augmented Generation (RAG)**: A hybrid approach combining retrieval-based and generative techniques. RAG systems first retrieve relevant documents or information from a large corpus and then generate responses based on the retrieved content. This approach enhances the accuracy and relevance of generated outputs.

In essence, AI leverages these advanced techniques to build systems that can perform sophisticated tasks, ranging from data analysis and prediction to natural language understanding and content generation.

Two things should be noted: on the one hand, **these are only statistical and analysis tools**, which go through large sets of data, very far from the functioning of a human brain. The other thing is that, for the end user, what is important is still the perception, to qualify as AI, so **these techniques will not necessarily be used in the product** that is sold as such.

# Just another buzzword ?

![Google Trends AI](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/j5yvqeq7lnn59pj124fg.png)

It has become the latest hype in IT, GenAI has propelled AI onto the podium, as have blockchain, VR headsets, or even 3D TVs, which, as we know, left the front of the stage as they came.

It is also good to remember that AI is a subject as old as computing itself, periods of craze followed by disinterest, called "[AI winters](https://en.wikipedia.org/wiki/AI_winter)", have been regularly observed, the first dating from 1966.


![AI Marketing](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ulg1jkxn32hvl3nfit23.jpeg)

The hype is such that in recent times, the term "AI" has been attached to most computer products, whether it has any real meaning or not, sometimes in a truly ridiculous or inappropriate way. Each application wants its "AI feature".

The same goes for computer conferences that were twisted into being on the topic of AI, even though the real topics were completely different.

One truth remains, this enthusiasm unlocks research funding, which allows us to believe that we will be able to see real progress emerge in the future.

# A threat ?

I don't know if you've noticed, but our thoughts often move much faster than our ability to act.

We are indeed witnessing progress currently, as well as an amplifying marketing and journalistic frenzy, of which we must not be fooled.

I'm not going to dwell too much on the subject, but we can discern worrying scenarios, which are the loss of jobs and loss of control.

## Loss of jobs

A widely talked about [study from the IMF](https://www.imf.org/en/Blogs/Articles/2024/01/14/ai-will-transform-the-global-economy-lets-make-sure-it-benefits-humanity) indicates that **40% of jobs would be affected** by AI. These predictions should be taken with a grain of salt for several reasons.

On the one hand, certain jobs were assigned impressively quickly, such as graphic designers or developers. These professions generally know how **to adapt to new technological** developments and **take advantage of them** to gain productivity, we cannot therefore talk about job losses. Besides, in the next section, I will talk about the tools that I use daily as a developer.

On the other hand, it must be taken into account that the development of new working methods, as all [industrial revolutions](https://en.wikipedia.org/wiki/Industrial_Revolution) have demonstrated, have not led all of humanity to idleness, but have contributed to the [creation of new jobs](https://www.quora.com/The-Industrial-Revolution-generated-a-lot-of-new-jobs-to-counteract-the-lost-jobs-Would-the-same-happen-with-advanced-AI-and-robotics-soon), whether qualified or not. Even if unemployment issues are very real, they are also nuanced and contextual.

![Civilization tree](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3etee9uvfhshoy0s3tul.png)

We must not hide our faces either, **we will observe changes due to paradigm shifts induced by AI**, such as recently the [elimination of jobs in Duolingo's translator teams](https://sh.reddit.com/r/duolingo/comments/18sx06i/big_layoff_at_duolingo/), the [deterioration of the DeviantArt website](https://slate.com/technology/2024/05/deviantart-what-happened-ai-decline-lawsuit-stability.html), [AI Crawlers](https://blog.cloudflare.com/declaring-your-aindependence-block-ai-bots-scrapers-and-crawlers-with-a-single-click), or many other examples.

What is certain is that jobs as we know them will evolve and the [skills needed will be different](https://www.talentlens.com/Insights/blog/2024/01/ai-influence-professional-skills.html), which concerns current and especially future generations.

## Loss of control

![AI SciFi](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4nq20zzeu9pl493oghhy.jpeg)

AI may take control of humans, betray them or even destroy them, that's what [Skynet](https://en.wikipedia.org/wiki/Skynet_(Terminator)), [HAL 9000](https://en.wikipedia.org/wiki/HAL_9000), [I, Robot](https://en.wikipedia.org/wiki/I,_Robot), or globally Hollywood and Pop Culture told us. We can also call it the "Hollywood AI".

These are only **extremely unlikely scenarios**. For this, the machine would have to truly emancipate itself from human command, have sufficient power of action, have a motive for such actions and above all **work completely differently than the tools we develop today**.

For the moment, all that's happening are **clickbait publications**, such as, for example, that [Google AIs are plotting among themselves in an unknown language](https://www.quora.com/Did-Google-really-create-AIs-that-they-had-to-disconnect-because-they-created-their-own-language-and-refused-to-communicate-in-the-language-the-designers-made-for-them), or that a [tool is working to destroy humanity](https://www.youtube.com/watch?v=g7YJIpkk7KM). 

It is important to be alerted to the threats that these new tools may have (we will talk about them again, particularly on privacy and ecology), but we must also put things into perspective and carefully check the sources of the informations we consume, to demystify things and understand them.

# Individual usage

The opening of access to the general public to ChatGPT at the beginning of 2023 was successful and its popularization was impressive.

The general public very quickly understood the services that it would provide them:

- Help with content generation (homework, articles, creations of all kinds)
- Search assistance, which replaces the Google engine
- Help with problem solving

This use has become a new common model, for example, for this search, it is simpler to ask ChatGPT to give me the solution, rather than searching from page to page to find my answer (and that's very complete) :

![ChatGPT Prompt](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/qegi6cz8jw2j8s0iw7yr.png)

Google, which has long been at the forefront in the field of AI, [suddenly found itself shaken up](https://the-decoder.com/ex-googler-says-companys-ai-panic-is-like-google-fiasco-all-over-again/) by the acquisition of ChatGPT by Microsoft. Google therefore finds itself in the situation of being confronted on the front line by these GenAI tools which aim to replace the classic Google search page, and it is not in a strong position.

Now, Google offers [Gemini](https://gemini.google.com/) (its ChatGPT competitor) on its home page and Bing offers [Copilot](https://www.microsoft.com/en-us/microsoft-copilot) (which uses the ChatGPT engine):

![Google Search - Gemini](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/32m66ur81138s7qvnabh.png)

![Bing Search - Copilot](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zia6pogybm75qnhqd67k.png)

Many tools on GenAI have emerged recently and are referenced on the [futuretools](https://www.futuretools.io/) site.

The next developments revolve around improving the engine: the completeness of its dataset, the speed of execution, as well as the recent update of the engine training and its internet access.

The other development is to be multimodal: this affects images, music and even video.

[Sora](https://openai.com/index/sora/), OpenAI's tool for generating video, unveiled a [fairly impressive video in Japan](https://www.youtube.com/watch?v=kHwFMFu9PhA), even if some imperfections were detected.

![Sora - Japan Scene](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/9i338nviipym85gw0g08.png)

These tools are very practical and impressive, but require human validation (or even editing) and [require new skills](https://roadmap.sh/prompt-engineering) to generate the most effective prompt possible.

Like any tool, it can also be misused, which can lead to the deterioration of some content available online. It is up to us to also be vigilant about the quality of the content we consume.

# Industry usage

**For developers**, Microsoft has been offering [Github Copilot](https://github.com/features/copilot) for several years now, which allows assistance with writing code (whether in autocomplete or via a prompt).

GenAI is also very useful for debugging phases, because it gives food for thought, hence the [reaction of Stack Overflow](https://stackoverflow.blog/2023/07/27/announcing-overflowai/)), which also offered an AI service.

![AI developer assistant](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/dg6o40rswmmfy8mf2xyu.jpeg)

**For Cloud architecture** usage, today the challenge is no longer to build your own Machine Learning or LLM models, given that they are available off the shelf by Cloud providers.

Each provider therefore offers a range of services to support the use of these technologies.

For the moment **[Google](https://cloud.google.com/products/ai?hl=en) and [Microsoft](https://azure.microsoft.com/en-us/solutions/ai) are in the lead**, AWS also offers a service called [Bedrock](https://aws.amazon.com/bedrock) that can use different Foundation Models, including [Mistral AI](https://mistral.ai).

![Google Cloud offer](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/uwds3ea87m0bnjebg2wf.jpg)

**AWS** also offers [Amazon Q](https://aws.amazon.com/q/?nc1=h_ls), a tool more focused on the [AIOps](https://www.gartner.com/smarterwithgartner/how-to-get-started-with-aiops) approach, which aims to integrate AI into the operational part.

It’s interesting to see that AWS, which has always been at the forefront of the market, **seems to be behind its competitors on GenAI**. We don't know how it will evolve, but **[they could surprise us](https://venturebeat.com/ai/aws-ai-takeover-5-cloud-winning-plays-theyre-using-to-dominate-the-market/)**, they are [investing actively](https://techcrunch.com/2024/06/13/amazon-says-itll-spend-230-million-on-generative-ai-startups/) in this domain.

![AWS offer](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5cm6cs2mr2k8th92zr9n.png)

At a time when we are talking about [sovereign cloud](https://cloud.google.com/sovereign-cloud?hl=en) and [GDPR](https://gdpr-info.eu) in Europe, GenAI represents an additional constraint in terms of data protection and will probably not be validated in all contexts (because usage means giving your data to the cloud provider that provides the service).

Despite everything, GAFAM are at the forefront but today a lot of brands are trying to associate their image as being at the cutting edge of AI, this extends to [automobile](https://podcasts.apple.com/fr/podcast/stellantis-tech-ai/id1727315032) or even [cycling](https://www.siroko.com/blog/c/artificial-intelligence-in-cycling/) industry.

# Limitations

The technology has developed well, but creates new problems inherent in the way it works and requires increased supervision:

- **Hallucinations**: To answer correctly, the model can very well invent informations from scratch with breathtaking confidence. This is why it is essential to scrupulously recheck everything before validating and ensuring that you have sufficient expertise for the area being addressed.
- **Bias**: For example in image generation, you type: “Show me a CEO”: the generator will only output images of tall brown men with white skin. These are clichés that can become even more ingrained in our way of thinking, instead of encouraging diversity.
- **Reasoning problems**: The model does not have our way of thinking and is capable of making grotesque errors, certain examples demonstrate this: “Making a sentence without the letter e", “Give a positive prime numbers after 2”, etc. The engine returns logical errors with the greatest confidence.

These problems are however [corrected with each version](https://www.lesswrong.com/posts/t9qvdjY5385MbzoYp/chatgpt-4-solved-all-the-gotcha-problems-i-posed-that), but will never be corrected completely.

We must also not forget the **problems already inherent in computing**, which are greatly amplified by AI models and constitute, more than anything else, **the real problems caused by AI**:

- **Privacy**: Data models recover a large amount of information, of which we do not necessarily have the capacity to verify whether they are respectful of privacy or not, we have to trust the software provider. There is a particular [topic with Meta about the use of personal information](https://www.thejournal.ie/facebook-data-ai-6391876-May2024/) to train its models.
- **Ecology**: Climate issues are more than ever at the forefront, at a time when we could instead advocate a form of energy saving, AI models consume a lot of resources: even though this information is kept private, we can clearly imagine (confirmed among others by a [Sam Altman declaration](https://www.reuters.com/technology/openai-ceo-altman-says-davos-future-ai-depends-energy-breakthrough-2024-01-16/)) that this represents [astronomical quantities of GPUs running constantly](https://www.visualcapitalist.com/training-costs-of-ai-models-over-time/) (which [makes Nvidia happy](https://www.marketwatch.com/story/nvidia-has-added-1-8-trillion-of-market-cap-in-2024-heres-how-big-that-is-2147d7c4)) and that it’s only growing, we can unfortunately [no longer count on Moore's law](https://robertkwiatkowski01.medium.com/is-moores-law-dead-dying-or-still-alive-a931ad9475a9) to compensate.

# Regulation

Failing to be at the forefront in the field of creation, Europe has taken the step of being at the forefront in the field of regulation with the [AI Act](https://www.europarl.europa.eu/topics/en/article/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence). This is nevertheless a major advantage, because the problems posed are very real and complex in the regulation of such tools.

# Related topics

AI alone is not enough in itself, and makes it possible to develop other IT sectors such as the [cloud](https://en.wikipedia.org/wiki/Cloud_computing), [data](https://en.wikipedia.org/wiki/Data_(computer_science)), [chatbots](https://en.wikipedia.org/wiki/Chatbot) or even [robotics](https://en.wikipedia.org/wiki/Robotics), which are very related subjects. For the years to come we can imagine that combined progress in these different sectors could once again change the situation in the technological field.

# To conclude

The IT market has found itself extremely shaken up recently: all software wants to release its AI feature, **IT specialists suddenly have to be specialists in AI** and the big players are investing **colossal sums** to corner the market.

In this context, it is interesting to **adapt to take advantage of these technologies**, to always marvel at the progress and the help it brings us, but also to **be aware of the issues (particularly on the privacy and ecology side)**, hence the importance of regulation.

Keep in mind that the use of these technologies requires **reinforced supervision** in order to always produce quality work.

The big development that makes many people dream, but which is probably [not for tomorrow](https://venturebeat.com/ai/yann-lecun-ai-pioneer-sharply-criticizes-elon-musk-over-treatment-of-scientists-and-spreading-of-misinformation/), contrary to what Elon Musk said, is the [**AGI (Artificial General Intelligence)**](https://aws.amazon.com/what-is/artificial-general-intelligence/), maybe that will be the next breakthrough, or **maybe we will just get tired of AI**, saturated from having talked about it too much, until the next real update.

In any case, it is important to follow the news with full knowledge of the facts, by selecting your sources carefully and by following people who really practice AI and can talk about it without mystification, as do very well Yan Le Cun, Aurélie Jean and Luc Julia.

More progress is still to come and it is very likely that I will write other articles on these algorithms which work on data sets, which some have decided to call “AI”.