Debasish Dhal

DebasishDhal99

AI & ML interests

None yet

Recent Activity

reacted to ImranzamanML's post with 👍 5 days ago

Here is how we can calculate the size of any LLM model: Each parameter in LLM models is typically stored as a floating-point number. The size of each parameter in bytes depends on the precision. 32-bit precision: Each parameter takes 4 bytes. 16-bit precision: Each parameter takes 2 bytes To calculate the total memory usage of the model: Memory usage (in bytes) = No. of Parameters × Size of Each Parameter For example: 32-bit Precision (FP32) In 32-bit floating-point precision, each parameter takes 4 bytes. Memory usage in bytes = 1 billion parameters × 4 bytes 1,000,000,000 × 4 = 4,000,000,000 bytes In gigabytes: ≈ 3.73 GB 16-bit Precision (FP16) In 16-bit floating-point precision, each parameter takes 2 bytes. Memory usage in bytes = 1 billion parameters × 2 bytes 1,000,000,000 × 2 = 2,000,000,000 bytes In gigabytes: ≈ 1.86 GB It depends on whether you use 32-bit or 16-bit precision, a model with 1 billion parameters would use approximately 3.73 GB or 1.86 GB of memory, respectively.

upvoted a paper 7 days ago

A Survey on Knowledge Distillation of Large Language Models

new activity 9 days ago

DebasishDhal99/cloud-vs-temperature-data:[bot] Conversion to Parquet

View all activity

Organizations

DebasishDhal99's activity

New activity in DebasishDhal99/cloud-vs-temperature-data 9 days ago

[bot] Conversion to Parquet

#1 opened 10 days ago by

parquet-converter

New activity in DebasishDhal99/german-czech-paired-placenames 6 months ago

[bot] Conversion to Parquet

#2 opened about 1 year ago by

parquet-converter

New activity in OdiaGenAI-LLM/qwen_1.5_odia_7b 6 months ago

How to access the model?

#1 opened 6 months ago by

Salil-IND

New activity in DebasishDhal99/punjabi-instruction-dataset 9 months ago

Librarian Bot: Add language metadata for dataset

#2 opened 9 months ago by

librarian-bot

New activity in Hindi-data-hub/odaigen_hindi_pre_trained_sp 10 months ago

Dataset Viewer issue: UnexpectedError

#1 opened 10 months ago by

ShakshiPanwar

New activity in DebasishDhal99/punjabi-instruction-dataset 10 months ago

[bot] Conversion to Parquet

#1 opened 10 months ago by

parquet-converter

New activity in OdiaGenAI/RAG_Evaluation_Dataset 10 months ago

Librarian Bot: Add language metadata for dataset

#2 opened 10 months ago by

librarian-bot

New activity in ai4bharat/samanantar 11 months ago

Unable to download data for specific languages

#9 opened 11 months ago by

DebasishDhal99

New activity in ai4bharat/IndicQA about 1 year ago

Citation

#1 opened about 1 year ago by

DebasishDhal99

New activity in DebasishDhal99/Random-Walk-Visualization about 1 year ago

Generating image

#1 opened about 1 year ago by

DebasishDhal99

New activity in DebasishDhal99/german-czech-paired-placenames over 1 year ago

Updates

#1 opened over 1 year ago by

DebasishDhal99

Updates

#1 opened over 1 year ago by

DebasishDhal99