teleren/devto huggingface dataset:
Large Language Model
Tags: machinelearning, pauseai, storybytes, ai
Published: 2023-04-03 14:13:07


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gfmf7xtl7iuhp9ep45c4.png)

Regardless of our opinion of whether artificial Intelligence is good or bad, AI is driving and transforming. In today’s world, where data is the new Oil, AI is sitting on top and getting things done. But how is it getting it done? By all of us feeding AI with data.  Solutions like ChatGPT are growing at lightning speed based on users and data feeds. Fundamentally, LLMs are super-powerful text predictors. Given a prompt, they use machine learning to determine the most likely set of characters that follow the prompt. Companies like OpenAI spend much time and energy tweaking the models to improve the output. An army of human labellers “grade” the model's output, and the model learns and evolves. Once you have experimented with tools like Chat GPT or Bing's AI-powered search, you've probably noticed that the responses are maybe 80% correct, but they're said with absolute and unshakeable confidence. LLMs aren't able to validate their assumptions or test their hypotheses. They can only confirm whether what they’re saying is true or not with our help. They're playing a probability game and estimating that this set of questions seems compatible with this set from the prompt. Sometimes, parts of that response are nonsensical. The OpenAI team refers to these as “hallucinations”. As the technology improves, we can expect some rough edges to be smoothened down, but fundamentally, there will always be some inaccuracy. Accuracy will improve, but it'll never be “perfect”, as we all have different standards to define “perfect”. Lately, there have been some demanding calls on all AI labs to immediately pause the training of AI systems for at least six months more potent than GPT-4 as we are not ready with policies and compliance and train humans to differentiate what is driven by AI and what is not. AI research and development should be refocused on making today's robust, state-of-the-art systems more accurate, safe, interpretable, transparent, robust, aligned, trustworthy, and loyal. AI Training isn’t easy, but it can be exciting. With our imagination, we understand, based on any situation, a dog might even ignore the cat and choose something else to chase. Therefore, train AI with morals and values.
Music Monday — What are you listening to? (Classical Rock Edition)
Tags: watercooler, discuss, music
Published: 2023-04-03 14:11:21

_cover image source: [Queen](https://giphy.com/gifs/queen-bohemian-rhapsody-azIrzf9K1Vr3R2IQdo)_

**I know we've [gone down the classic rock road once before](https://dev.to/music-discussions/music-monday-what-are-you-listening-to-classic-rock-edition-5gcb), but today we're gonna put the focus on classical rock, by this I mean rock that has a classical music slant. Shout out to @darkterminal for [this fantastic suggestion](https://dev.to/darkterminal/comment/25fd5)! Now, I realize classical rock is a pretty narrow scope, so as always, if you don't have suggestions that fit, feel free to step outside the theme and drop us anything that you're enjoying listening to!**

![Bugs Bunny is dressed as a conductor and standing in from of an orchestra. Someone hands him a conductor's baton and he snaps it in half nonchalantly.](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5gqsu7wq4cjo6e7rts5a.gif)

***

## How we do 

In this weekly series, folks can chime in and drop links to whatever it is they've been listening to recently + browse others suggestions.

If you like talking about music, consider following the org [#music discussions](https://dev.to/music-discussions) for more conversations about music!

{% embed https://dev.to/music-discussions %}

***

Alright, let's Bach and roll! _Note: you can embed a link to your song using the following syntax `{% embed https://... %}`. This should work for most common platforms!_

Looking forward to listening to y'all's suggestions! 🎶
Building Lip Reading Model. Part-1
Tags: blog, machinelearning, datascience, python
Published: 2023-04-03 14:09:52

Lip reading, also known as speech reading, is the ability to understand speech by observing a speaker's lip movements and facial expressions. It is a crucial skill for individuals who are deaf or hard of hearing, as well as for those who need to communicate in noisy environments. However, lip reading is a challenging task that requires extensive training and experience, and even then, it can be unreliable due to variations in lip movements and speech patterns.

Recent advances in machine learning and computer vision have made it possible to develop automatic lip reading systems that can recognize speech from visual cues alone. These systems have numerous applications, from enhancing speech recognition in noisy environments to improving the accessibility of multimedia content for the deaf and hard of hearing.

In this blog series, we will explore how to build a lip reading model using deep learning techniques. In Part 1, we will cover the basics of lip reading and the dataset we will be using for our model.

## Understanding Lip Reading

Lip reading involves analyzing the movements of the mouth, tongue, and jaw to determine the sounds being produced by a speaker. There are several challenges associated with lip reading, including variations in speech patterns, differences in accent and dialect, and the fact that many sounds are produced inside the mouth and are not visible on the lips.

Despite these challenges, lip reading is a useful skill that can be learned with practice. It is typically taught using a combination of visual cues, such as the shape of the lips and the movement of the jaw, and contextual cues, such as the topic of conversation and the speaker's body language.

## Dataset

The Grid Corpus dataset is a widely used dataset in the field of lip reading, which contains videos of people speaking a wide range of words. The dataset was created by recording videos of speakers reading out sentences while their faces were tracked using a facial landmark detection algorithm. The dataset contains over 30,000 video clips, each clip corresponding to a spoken sentence.

The videos in the dataset are captured at a resolution of 640x480 and a frame rate of 25 frames per second. The dataset also includes the corresponding audio for each video clip, as well as the transcriptions of the spoken sentences.

The Grid Corpus dataset has been used in numerous studies to develop and evaluate lip reading models. Some of the popular models developed using this dataset include LipNet and Watch, Listen, and Spell (WLAS).

## Conclusion

In Part 1 of this blog series, we have introduced the concept of lip reading and the dataset we will be using to train our lip reading model. In the next part of the series, we will explore the preprocessing steps required to prepare the Lip Reading dataset for training, including data cleaning and feature extraction. Stay tuned for Part 2!
Architect and Build an End-to-End AWS Web Application from Scratch
Published: 2023-04-03 14:09:41

In this short article, I will walk through the steps I used to build an end-to-end AWS web application from scratch.

The first step in building an AWS web application is to create a basic index HTML file using a text editor like Notepad++. Once I created the index HTML file, I chose to host it on Amplify. 

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wzbd2jlgvyg8e8gvtlhj.png)

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/m76z9w2efr0gs58w3llv.png)

To ensure that my HTML file works, I tested the domain which worked. A pretty basic website, but it works!

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/41vsk4mtdenby025cslv.png)

Next i created a Lambda function and tested using lambda test event to check lambda code works.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/78nfebc9x19rpskmhdpz.png)

My next step was to configured REST API for lambda function using API gateway and again test to see if it works.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3s4kozk4spcvho9nm4mj.png)


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vpuoobsfj64fn3b01hhh.png)

To store the user input data I decided to use DynamoDB and configured my database.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/x92x1qo43sq7s5kq6ryk.png)

I had to edited the IAM policy for Lambda function to allow DynamoDB permissions.


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vzdjggrn5jlpxlquzha3.png)

I then updated lambda function code to save user results to DynamoDB table and again tested my lambda function to make sure the updates show on DynamoDB table.


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/70o0e1j4zjpk01jz68g5.png)

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/caxfgpyiz70owj8bfjmv.png)

Next step was to updated Index HTML file with CSS for styling and updated my HTML code.


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/h90s7w7zyrd86qa10lkd.png) 


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ty2vcolgv0bc588nchc7.png)

I then updated my updated Index HTML Zip file to Amplify. 


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/53nihg29e8mrnmkvnrx4.png)

My to the power of math website was complete whoop whoop, I just needed to the the final testing with user input.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/igsljxiymh1cenzc760t.png)

This was a fun project and allowed me to combine multiple AWS services to create a website from scratch, I used Amplify for the first time which turned out to be very easy to use.
តើធ្វើដូចម្តេចទើបមានការឆ្នៃប្រឌិតក្នុងការសរសេកូដ?
Tags: programming, khmer, tips, experience
Published: 2023-04-03 13:58:48

ធ្វើអ្វីដែលគិតថាវានិងមានលទ្ធផល គឺជាផ្និតគំនិតវិជ្ជមាន។
ពេលជូបឧបសគ្គដូចជា Errors តែព្យាយាមស្វែងរកដំណោះស្រាយឲអស់គ្រប់វិធី គឺជាអ្នកមិនបោះបង់។
ធ្វើច្រើន Errorsតែងមានច្រើនដែរ តែមានអារមណ៍ថាខ្លួនចេះមិនទាន់ចេះដល់ គឺជាអ្នកស្វែងរកអ្វីដែលថ្មី។
ទម្លាប់អានអ្វីដែលពិបាកយល់ ក្រោយពេលយល់ទើបដឹងថាគេចង់និយាយអំពីអី គឺជាចេះស្វែងរកការពិត :D ។
រឿងមួយដែលសំខាន់នុះគឺធ្វើអ្វីដែលគេយកទៅប្រើ អានអ្វីដែលអ្នកចង់យល់ ទើបជីវិតជា programmer មានន័យ។
សួស្ដី[0]
FastAPI New Version
Tags: fastapi, python
Published: 2023-04-03 13:58:37

✔️ Invitation to collaborate on an open source project
Project Link:
https://github.com/ManiMozaffar/fastapi-integration

The goal of this project is to create a library that makes working with FastAPI easier and suitable for monolithic and smaller projects, similar to Django. In this library, features such as admin panel, command-line interface, and ORM using asyncpg and SQLAlchemy will be designed. In addition, other packages designed for FastAPI that support Asyncpg and SQLAlchemy will be added to the library.
One example of this library is QueryMixin, which makes SqlAlchemy similar to Django:
https://github.com/ManiMozaffar/fastapi-integration/blob/main/fastapi_integration/queries/base.py

Like DRF, this library has a built-in pagination that shows links to the next and previous pages. It also has a CRUD class that uses the generic view method:
https://github.com/ManiMozaffar/fastapi-integration/blob/main/fastapi_integration/generic/crud.py


Also, this library has a FastAPI app engine that you can visit from the link below. Its installation will not be a problem:
https://github.com/ManiMozaffar/fastapi-integration/blob/main/fastapi_integration/__init__.py

This project is still in its early stages and needs a lot of help. If you think this library is useful, please support it by giving it a star.
To participate in the project, please contact the following Telegram ID or email:

t.me/mani_nikou
mozaffar20@itu.edu.tr
Processing in parallel with Groovy
Tags: groovy
Published: 2023-04-03 13:52:57

I had to place thousands of messages on a queue and collect each response by an ID. This is how I used multiprocessing to do that, so that messages were processed in parallel to make it complete faster:


  
    //lists to keep the thread instances
    List threads1 = []
    List threads2 = []

    //first task (e.g. putting on Q)
    def doThis = { i, j ->
        sleep(randNum(100))
        println "doThis(${i}) thread: ${j}"
    }

    //second task (e.g. getting from Q)
    def doThat = { i, j ->
        sleep(randNum(20000))
        println "doThat(${i}) thread: ${j}"
    }

    //call first task (e.g. for eachRow from DB, put msg on Q)
    20.times { i ->
        def t1
        t1 = Thread.start { doThis(i, t1.name) }
        threads1.add(t1)
    }

    //wait for all task 1 threads to end
    for (thread in threads1) {
        thread.join()
        println "doThis joined: ${thread.name}"
    }

    //call second task (e.g. for each correlation ID, get msg from Q)
    20.times { i ->
        def t2
        t2 = Thread.start { doThat(i, t2.name) }
        threads2.add(t2)
    }

    //wait for all task 2 threads to end
    for (thread in threads2) {
        thread.join()
        println "doThat joined: ${thread.name}"
    }

    println "All threads done"

    def randNum(maxSize) { //create random wait times
        return Math.abs(new Random().nextInt() % maxSize) + 1 
    }
RE: Tell us about yourself
Published: 2023-03-18 19:16:36

My name is Macke and I have been coding on a regular basis since 2004. My first line of code was written back in 1997/98 in a text book at school.

I got in touch with markup at first and added upon that as time went. Front-end developing was pretty natural for me. I think the main reason for going the front-end path, was because I had no one in my proximity doing only backend.

Back then, web sites was build in notepad and then "deployed" to one of all the free hosting sites. I remember using cjb.net (If i reacall correctly) a lot.

Time went, portfolio got bigger and bigger. Coding was not yet something I did for pay, only for the fun of it. I applied to community college and went there for a couple of years. There I really connected with the web. This was in 2004.

I got into wordpress. This is where I got to experience backend for the first time. It was a lot of fun.

In 2006-7 I joined a local web design company and got my first job as a developer, or developing was just a part of the job. I had many hats back then, mainly design and coding. This was my entry and I will forever be grateful for that part of my life.

**Years came and went as fast as web tech. Went from:**

- HTML / CSS to,
- PHP / Wordpress to,
- jQuery / Javascript to,
- Angular.js / Angular to,
- Vue to,
- React

And here I am today. I love coding and are happy that I get to do it for a living, providing to the family.

But I have lately felt there is something missing. Maybe not missing, but something I want to add to my legacy as a web developer. And that is to share what I know, what i get to know in the future.

My goal is to publish one story a week. I need practice.

Nice to meet you. Lets go.
25 Tools & Extra Tactics For App Security [Free Ebook]
Tags: security, aws, cybersecurity, testing
Published: 2023-04-03 13:44:52

**Download the free ebook about web and mobile app security. This ebook is a security deep dive for software developers as well as app owners, startups, and larger companies. Discover tools, resources, and guides that, step by step, will verify if your app is secure.**

**[Download the free ebook](https://brightinventions.pl/blog/app-security-free-ebook)**

## What’s inside the ebook?

Check out the table of contents:

1. Why should I bother?
2. How should I start?
3. Introduction to OWASP.
4. Automated security testing.
5. Infrastructure reconnaissance.
6. Infrastructure security.
7. Security monitoring.
8. The end.
9. Author.
10. Security software tools directory.

## Security software tools directory

We listed every mentioned tool so you can easily go through them and start testing recommended solutions for your product.

## Learn more about the author

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5biv56dvqf0fzkkuneqp.png)

The ebook “25 Tools & Extra Tactics For App Security” was written by Rafał Hofman, Fullstack Developer at Bright Inventions. Rafał is a software developer with over 5 years of experience. He focuses on web security and specializes in Ethereum blockchain development.

Ready to digest a solid portion of security knowledge? [Get the free ebook!](https://brightinventions.pl/blog/app-security-free-ebook)
Understanding Data Types in JavaScript ( Part - 3 )
Tags: javascript, beginners, programming, makstyle119
Published: 2023-04-03 13:43:33

In **JavaScript**, the **object data type** is used to represent complex data structures. There are three main types of object data types in JavaScript: **object**, **array**, and **date**. In this blog post, we will discuss each of these object data types in detail and provide examples of how to work with them in JavaScript.

**Object:**

The object data type is used to represent a collection of key-value pairs. An object can be created using the curly braces ``{}`` syntax or the new ``Object()`` syntax. For example:

```javascript
const person = {
  firstName: 'John',
  lastName: 'Doe',
  age: 30
};
console.log(person); // logs {firstName: "John", lastName: "Doe", age: 30}
```

In this example, we have created a ``person`` object with three properties: ``firstName``, ``lastName``, and ``age``. The ``console.log`` statement logs the entire person object.

**Array:**

The array data type is used to represent a collection of values. An array can be created using the square brackets [] syntax or the new Array() syntax. For example:

```javascript
const fruits = ['apple', 'banana', 'orange'];
console.log(fruits); // logs ["apple", "banana", "orange"]
```

In this example, we have created a ``fruits`` array with three values: ``'apple'``, ``'banana'``, and ``'orange'``. The ``console.log`` statement logs the entire ``fruits`` array.

**Date:**

The date data type is used to represent a date and time. Dates can be created using the ``new Date()`` syntax. For example:

```javascript
const now = new Date();
console.log(now); // logs the current date and time
```

In this example, we have created a ``now`` date object using the ``new Date()`` syntax. The ``console.log`` statement logs the current date and time.

**Conclusion:**

The object data type is used to represent complex data structures in **JavaScript**. There are three main types of object data types in JavaScript: **object**, **array**, and **date**. By understanding how to work with these object data types, you can write more effective and efficient code in your JavaScript programs.
Code Brew Labs | Trending Ecommerce Marketplace Development Company Dubai
Tags: ecommerce, marketplacedevelopment, multivendormarketplace, b2bmarketplacedevelopment
Published: 2023-04-03 13:42:45


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/d06ku4bvsql45f41sofw.png)
Code Brew Labs is ranked no.1 as the top app development company in Dubai as it carries many records in the IT field such as 6000+ startups empowered with 120+ million funded startups so far. Get your best [e-commerce marketplace development](https://www.code-brew.com/build-your-online-marketplace-platform/) deals with us. we offer exciting app development packages with the latest technology at a reasonable cost.visit our official website for further details.
Presentation of a Dev wanting to learn from the community
Tags: programming, career, beginners
Published: 2023-04-03 13:07:37


Hi all!

My name is **Jean Vidal** and I'm a **Brazilian Full Stack Developer**. 

Currently i work with React (starting with NextJS on personal projects) on FrontEnd and .Net Core on BackEnd, but I already had experience with AngularJS, VueJS, Asp. Net, NodeJS, etc.

I'm trying to work globally and i'm preparing myself every day my tech and soft skills.

Starting today, i'm will to try share knowladges with all and write regularly to improve my English comunication and learn something to train/practice and improve my tech skills, in addition to increasing my vocabulary too.

I ask you to help me with this and feel free to correct me constructively, be it tech and soft skills as well as vocabulary.

If you want to get in touch with me, follow my networks:

[Linkedin](https://www.linkedin.com/in/jvidalnunes/)
[GitHub](https://github.com/JVidalN)
[Twitter](https://twitter.com/JVidalN)
[Medium](https://medium.com/@jvidaln)
Understanding Basics of Node.js
Tags: webdev, javascript, node
Published: 2023-04-03 13:02:45



## Introduction
Node.js is a javascript runtime environment built on [V8 engine](https://v8.dev/). It is open-source, single threaded and is used to make **server-side** applications. 


Lets understand by visualization how node.js works
![An visual overview of how node.js works](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8tn2j5eqkv7ogvvyymzh.png) 

##Modules in Node
 Core feature of node is modules. Modules are simple or complex
task that are pre-build in them. Each module in Node.js has its own context, so it cannot interfere with other modules or pollute global scope. It is based on common [Javascript modules standard](https://requirejs.org/docs/commonjs.html)
Modules are of three types:

- **Core**: In built modules that are pre installed with node.js
 
- **Local**: Local modules are modules created locally in your Node.js application.

- **Third-Party**: External packages that are installed via package managers like  [npm](https://www.npmjs.com/) or [yarn](https://yarnpkg.com/).

##Node package Manager(NPM)
"There is a npm package for that."
 This quote sums up importance of npm. It allows third party packages to be installed to your project. Anyone can upload their
 packages to website and allow others to use.

#Example
Now that we  take a look at the basics of node.js lets write a program that covers http module in node used for backend development.
```
var http = require('http');

http.createServer(function (req, res) {
  res.write('Hello World!');  
  res.end();  
}).listen(8080); 
```
In above code at line 1 http module is imported as it is a Core module in node.js.
createserver is used to create a  server
res,req represents request and response of the server
.listen() represents on which port the requests are going to be heard.
The output of the following  server would be on port 8000:

 
![Output of the above server](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4mzooinjsqh03m4tbzp7.png)

This has been basics of node.js. More documentation can always be found on [node docs](https://nodejs.org/en/docs/).Thank you for reading
It is time to accelerate your Real Estate and Construction business with our award winning In4Suite®
Tags: erp, erpsolutions, realestatesoftware, constructionsoftware
Published: 2023-04-03 12:59:24

Apply real estate and construction ERP tools to automate and streamline company operations. Our main product base, [In4Suite®](https://www.in4velocity.com/), is the ideal choice for real estate experts and is pronounced info-suite. To give end customers a thorough and finished piece of business software, it incorporates a number of integrated modules and features. All the components are available for purchase and use, but they can also be acquired individually in a scalable manner as and when a company expands.