cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.5281/zenodo.17563728
title: IJOBAS TDD Mobile Language - Datasets and Experiment Results

description: This repository contains the experimental data and analysis for a research study demonstrating how **Test-Driven Prompting (TDP)** significantly improves AI code generation across multiple programming languages and difficulty levels. All experimental data, statistical analysis, and qualitative comparisons are included.


## What is Test-Driven Prompting?


Instead of just asking an AI to write code, Test-Driven Prompting includes example test cases in the prompt. This helps the AI understand exactly what the code should do, similar to how human programmers use test-driven development.


![alt text](methodology_overview.png)


## Key Findings


Our study tested 4 different AI models (GPT-4, Claude, Qwen) on Android (Java) and iOS (Swift) and found:


- 🎯 First mobile evaluation: While TDP has mainly been studied for Python, this is the first empirical study of TDP in mobile development (Java, Swift).

- 🔬 Scope & scale: 8,704 evaluations across 544 programming tasks (HumanEval, MBPP), comparing two prompting strategies (base, test-driven) and four LLMs (GPT-4o, GPT-4o-mini, Qwen 14B, Qwen 32B).

- 📈 Measured effect: Average accuracy increase of +2.22 percentage points (pp) over baseline for TDP (95% CI [1.22–3.23 pp], p < 0.001, d = 0.3974).

- 📉 Platform differences: LLMs perform worse on mobile languages (66.85%–88.87%) than on Python (86.90%–91.30%), and exhibit reduced responsiveness to TDP in mobile development.

- ⚖️ Practical guidance: We provide recommendations for choosing trade-offs (max accuracy vs. budget vs. self-hosted) and offer platform-specific suggestions for applying TDP.


TDP is a reliable, low-overhead prompt engineering method for mobile app development that integrates smoothly with existing test-driven workflows; we recommend researchers and practitioners adopt TDP as a standard part of LLM-assisted mobile development.


## Authors


**Muhammad Rizqullah** (<mrizqullah@stu.kau.edu.sa>) and **Emad Albassam** (<ealbassam@kau.edu.sa>)

Computer Science Department, King Abdulaziz University, Jeddah, Saudi Arabia


*Corresponding author: Muhammad Rizqullah. Any enquiries about the research should be directed to him.*


## Repository Structure


- `datasets/` - Programming problems and test cases from HumanEval, MBPP, and Code Contests

- `raw_results/` - Complete experimental results for each AI model and dataset combination

- `results/` - Statistical analysis and comparison reports
DOI: 10.5281/zenodo.17563729
title: IJOBAS TDD Mobile Language - Datasets and Experiment Results

description: This repository contains the experimental data and analysis for a research study demonstrating how **Test-Driven Prompting (TDP)** significantly improves AI code generation across multiple programming languages and difficulty levels. All experimental data, statistical analysis, and qualitative comparisons are included.


## What is Test-Driven Prompting?


Instead of just asking an AI to write code, Test-Driven Prompting includes example test cases in the prompt. This helps the AI understand exactly what the code should do, similar to how human programmers use test-driven development.


![alt text](methodology_overview.png)


## Key Findings


Our study tested 4 different AI models (GPT-4, Claude, Qwen) on Android (Java) and iOS (Swift) and found:


- 🎯 First mobile evaluation: While TDP has mainly been studied for Python, this is the first empirical study of TDP in mobile development (Java, Swift).

- 🔬 Scope & scale: 8,704 evaluations across 544 programming tasks (HumanEval, MBPP), comparing two prompting strategies (base, test-driven) and four LLMs (GPT-4o, GPT-4o-mini, Qwen 14B, Qwen 32B).

- 📈 Measured effect: Average accuracy increase of +2.22 percentage points (pp) over baseline for TDP (95% CI [1.22–3.23 pp], p < 0.001, d = 0.3974).

- 📉 Platform differences: LLMs perform worse on mobile languages (66.85%–88.87%) than on Python (86.90%–91.30%), and exhibit reduced responsiveness to TDP in mobile development.

- ⚖️ Practical guidance: We provide recommendations for choosing trade-offs (max accuracy vs. budget vs. self-hosted) and offer platform-specific suggestions for applying TDP.


TDP is a reliable, low-overhead prompt engineering method for mobile app development that integrates smoothly with existing test-driven workflows; we recommend researchers and practitioners adopt TDP as a standard part of LLM-assisted mobile development.


## Authors


**Muhammad Rizqullah** (<mrizqullah@stu.kau.edu.sa>) and **Emad Albassam** (<ealbassam@kau.edu.sa>)

Computer Science Department, King Abdulaziz University, Jeddah, Saudi Arabia


*Corresponding author: Muhammad Rizqullah. Any enquiries about the research should be directed to him.*


## Repository Structure


- `datasets/` - Programming problems and test cases from HumanEval, MBPP, and Code Contests

- `raw_results/` - Complete experimental results for each AI model and dataset combination

- `results/` - Statistical analysis and comparison reports
DOI: 10.25549/gar-c81-29536
title: Neatha H. Seger, letter, 1905-07-08 to Hamlin Garland

description: Neatha H. Seger (E.D. Foster & Company, successors to N.H. Seger & Company), Colony, Oklahoma, USA, letter, 1905 July 8, to Hamlin Garland, West Salem, Wisconsin, USA. "Your letter of the 4th inst[ant] at hand." -- first line. With envelope.
DOI: 10.5281/zenodo.17561267
title: Swedish word2vec embeddings trained on OpenSubtitles Part 2

description: This dataset contains the subs2vec embeddings for Swedish, as presented in https://zenodo.org/records/17243814. The embeddings were trained on large-scale subtitle corpora and represent semantic vector spaces derived from naturalistic language use in films and television from the OpenSubtitles 2018 datasets: https://opus.nlpl.eu/OpenSubtitles/corpus/version/OpenSubtitles.

For this language, we provide all embedding variants explored in the study. Specifically, the dataset includes vectors generated under different combinations of:





Dimensionality: multiple vector sizes (e.g., 100, 200, 300, …)




Window size: varying context windows (e.g., 2, 5, 10, …)




Each file corresponds to a unique configuration (dimension × window size). 



Each file contains the vocabulary for that language (column 1) and then the embedding values (columns 2 through dimension size + 1).

If you use this dataset, please cite:





Manuscript: https://doi.org/10.5281/zenodo.17243812 




Data: This Zenodo dataset (using the DOI provided here)
DOI: 10.5281/zenodo.17561268
title: Swedish word2vec embeddings trained on OpenSubtitles Part 2

description: This dataset contains the subs2vec embeddings for Swedish, as presented in https://zenodo.org/records/17243814. The embeddings were trained on large-scale subtitle corpora and represent semantic vector spaces derived from naturalistic language use in films and television from the OpenSubtitles 2018 datasets: https://opus.nlpl.eu/OpenSubtitles/corpus/version/OpenSubtitles.

For this language, we provide all embedding variants explored in the study. Specifically, the dataset includes vectors generated under different combinations of:





Dimensionality: multiple vector sizes (e.g., 100, 200, 300, …)




Window size: varying context windows (e.g., 2, 5, 10, …)




Each file corresponds to a unique configuration (dimension × window size). 



Each file contains the vocabulary for that language (column 1) and then the embedding values (columns 2 through dimension size + 1).

If you use this dataset, please cite:





Manuscript: https://doi.org/10.5281/zenodo.17243812 




Data: This Zenodo dataset (using the DOI provided here)
DOI: 10.25549/gar-c81-35016
title: Arthur Whiting, letter, [no year]-10-18, to Hamlin Garland

description: Arthur Whiting, 141 East 40th Street, New York, New York, USA, letter, [no year] October 18, to Hamlin Garland. "Thank you for the offer of tickets to hear Mr. Johnson." -- first line.
DOI: 10.25549/gar-c81-30322
title: John H. Seger, letter, 1908-01-02, to Hamlin Garland

description: John H. Seger, Colony, Oklahoma, USA, letter, 1908 January 2, to Hamlin Garland. "I wrote to you some time ago and have been looking for an answer." -- first line. With envelope.
DOI: 10.25549/gar-c81-29459
title: Hamlin Garland, letter, 1913-04-28, to Henry D. Sedgwick

description: Hamlin Garland, letter, 1913 April 28, to Henry D. Sedgwick ([National Institute of Arts and Letters]). "The special invitation should go out with all the authority of the Institute and Academy, and perhaps from your office." -- first line.
DOI: 10.25549/gar-c81-26600
title: Ernest Poole, letter, 1923-05-15, to Hamlin Garland

description: Ernest Poole (The Foreign Press Service), 215 West 33rd Street, New York, New York, USA, letter, 1923 May 15, to Hamlin Garland, 71 East 92nd Street, New York, New York, USA. "My very sincere and hearty thanks for your good word about my book His Family." -- first line.
DOI: 10.25549/gar-c81-26959
title: William Lyon Phelps, letter, 1922-04-10, to Hamlin Garland

description: William Lyon Phelps, Yale University, New Haven, Connecticut, USA, letter, 1922 April 10, to Hamlin Garland. "It is necessary that we hand in the report about the plays at once." -- first line.
DOI: 10.25549/gar-c81-26317
title: William Lyon Phelps, letter, 1930-11-02, to Hamlin Garland

description: William Lyon Phelps, Yale University, New Haven, Connecticut, USA, letter, 1930 November 2, to Hamlin Garland. "Your book Roadside Meetings is continuously, unflaggingly interesting!" -- first line.
DOI: 10.25549/gar-c81-26342
title: John Sanburn Phillips, letter, 1896-12-16, to Hamlin Garland

description: John Sanburn Phillips (The S.S. McClure Company), 141-155 East 25th Street, New York, New York, USA, letter, 1896 December 16, to Hamlin Garland, Terminal Hotel, Saint Louis, Missouri, USA. "I am glad that you are getting so well along with the work." -- first line.
DOI: 10.25549/gar-c81-26366
title: Earl T. Platt, letter, 1935-07-22, to Hamlin Garland

description: Earl T. Platt (University Extension Division), The University of Nebraska, Lincoln, Nebraska, USA, letter, 1935 July 22, to Hamlin Garland, Laughlin Park, [Hollywood], Los Angeles, California, USA. "We are preparing a Supervised Correspondence Study course in the History of American Literature in which we are using Cross-Smith-Stauffer -- American Writers -- Good Reading for High Schools as a basic text." -- first line.
DOI: 10.25549/gar-c81-26659
title: Hamlin Garland, letter, 1916-11-02, to William Lyon Phelps

description: Hamlin Garland, 71 East 92nd Street, New York, New York, USA, letter, [1916] November 2, to William Lyon Phelps. "I am glad you spoke of 'The High Trails' -- I don't care to lie under a misapprehension in your mind." -- first line.
DOI: 10.25549/gar-c81-27002
title: William Lyon Phelps, letter, [s.d.], to Hamlin Garland

description: William Lyon Phelps, letter, [s.d.], to Hamlin Garland. "Albert bigelow Paine -- yes; Irving Bacheller -- yes; Rupert Hughes -- yes; yes -- Vachel Lindsay; John G. Neihardt -- no..." -- first line. With a short response from Garland handwritten below.
DOI: 10.25549/gar-c81-26896
title: Hamlin Garland, letter, 1939-06-14, to Jocelyn Pierson

description: Hamlin Garland, 2045 De Mille Drive, [Laughlin Park, Hollywood], Los Angeles, California, USA, letter, [1939] June 14, to Jocelyn Pierson. "I replied hurriedly yesterday in order to get word to you about the ms [manuscript] in Dutton's hands." -- first line.
DOI: 10.25549/gar-c81-26747
title: Stephen D. Polychronopoulos, letter, 1937-02-02, to Hamlin Garland

description: Stephen D. Polychronopoulos, 1243 Arapahoe Street, Los Angeles, California, USA, letter, 1937 February 2, to Hamlin Garland, 2045 De Mille Drive, [Laughlin Park], Hollywood, Los Angeles, California, USA. "I am taking the liberty of writing you in an effort to locate someone who is capable of collaborating with me in a very interesting literary work which has great literary merits and financial possibilities." -- first line.
DOI: 10.25549/gar-c81-26979
title: A. Kingsley Porter, letter, 1919-11-20, to Hamlin Garland

description: A. Kingsley Porter, 450 West End Avenue, New York, New York, USA, letter, 1919 November 20, to Hamlin Garland. "May I leave it open to come if I can?" -- first line.
DOI: 10.25549/gar-c81-27042
title: Charles H. Piper, letter, 1920-03-23, to Hamlin Garland

description: Charles H. Piper, 21 Seaverns Avenue, Jamaica Plain, Boston, Massachusetts, USA, letter, 1920 March 23, to Hamlin Garland. "You will pardon I think ans[wer] on your ½ sheet, but it's handy." -- first line.
DOI: 10.25549/gar-c81-26316
title: William Lyon Phelps, letter, 1930-11-02, to Hamlin Garland

description: William Lyon Phelps, Yale University, New Haven, Connecticut, USA, letter, 1930 November 2, to Hamlin Garland. "Your book Roadside Meetings is continuously, unflaggingly interesting!" -- first line.
DOI: 10.25549/gar-c81-26878
title: Ernest Poole, letter, 1917-04, to Hamlin Garland

description: Ernest Poole (The Players), 16 Gramercy Park, New York, New York, USA, letter, [1917? April], to Hamlin Garland. "Thank you for your note. I've been hoping to see you here at the Club and ask if by your note you mean you are willing to have your name signed with the others to the statement I sent you." -- first line.
DOI: 10.25549/gar-c81-27039
title: John Sanburn Phillips, letter, 1900-04-02, to Hamlin Garland

description: John Sanburn Phillips (S.S. McClure), 141-155 East 25th Street, New York, New York, USA, letter, 1900 April 2, to Hamlin Garland, 474 Elm Street, Chicago, Illinois, USA. "I have twisted and turned and calculated and tried to get at this business of ours." -- first line.
DOI: 10.25549/gar-c81-26993
title: Jocelyn Pierson, letter, 1939-12-01, to Hamlin Garland

description: Jocelyn Pierson (American Society for Psychical Research), 40 East 34th Street, New York, New York, USA, letter, 1939 December 1, to Hamlin Garland, 2045 De Mille Drive, [Laughlin Park], Hollywood, Los Angeles, California, USA. "Please accept my apologies for not replying to your letter sooner." -- first line.
DOI: 10.25549/gar-c81-38929
title: William Dean Howells, letter, 1905-08-20, to Hamlin Garland

description: William Dean Howells, Kittery Point, Kittery, Maine, USA, letter, 1905 August 20, to Hamlin Garland, [357 West Garland Street [later named]], West Salem, Wisconsin, USA. "But for the witness of your letter, which has lain all these weeks and months on my table vainly reproaching me, I should not have believed I could let you go unanswered so long." -- first line. With envelope.
DOI: 10.25549/gar-c81-25749
title: Hamlin Garland, letter, 1914-04-08, to Charles Gilman Norris

description: Hamlin Garland, letter, 1914 April 8, to Charles Gilman Norris, 106 Bible House, New York, New York, USA. "I am very much obliged for the promise of the MS." -- first line.
DOI: 10.25549/gar-c81-34327
title: Post Wheeler, letter, 1923-02-16, to Hamlin Garland

description: Post Wheeler (Embassy of the United States of America), London, England, letter, 1923 February 16, to Hamlin Garland, 71 East 92nd Street, New York, New York, USA. "Hallie and I are certainly pleased to know that you are again for this direction." -- first line.
DOI: 10.25549/gar-c81-35916
title: William Allen White, letter, 1896-12-09, to Hamlin Garland

description: William Allen White (The Emporia Gazette), Emporia, Kansas, USA, letter, 1896 December 9, to Hamlin Garland. "Your kind note of the 7th came today and made me happy." -- first line.
DOI: 10.25549/gar-c81-25990
title: Charles Gilman Norris, letter, 1914-08-18, to Hamlin Garland

description: Charles Gilman Norris, Port Washington, New York, USA, letter, 1914 August 18, to Hamlin Garland (The Cliff Dwellers), 168 South Michigan Avenue, Chicago, Illinois, USA. "I remember quite well Mr. Phillips of the American Magazine showing me your letter addressed to him…" -- first line.
DOI: 10.25549/gar-c81-35407
title: Stewart Edward White, letter, 1936-05-13, to Hamlin Garland

description: Stewart Edward White, Little Hill, Burlingame, California, USA, letter, 1936 May 13, to Hamlin Garland. "The psychic book came last night, and while of course I have not yet had a chance to read it in detail, I flipped over the pages." -- first line. With typed transcription.
DOI: 10.25549/gar-c81-29750
title: John H. Seger, letter, 1905-06-16, to Hamlin Garland

description: John H. Seger, Colony Indian School, Colony, Oklahoma, USA, letter, 1905 June 16, to Hamlin Garland. "We are having fine growing weather here now. Crops of all kinds look splendid." -- first line.
DOI: 10.25549/gar-c81-35664
title: Stewart Edward White, letter, 1937-04-11, to Hamlin Garland

description: Stewart Edward White, Little Hill, Burlingame, California, USA, letter, 1937 April 11, to Hamlin Garland. "By golly, it certainly sounds as though you were getting somewhere!" -- first line.
DOI: 10.25549/gar-c81-34080
title: Stewart Edward White, letter, 1937-05-21, to Hamlin Garland

description: Stewart Edward White, Little Hill, Burlingame, California, USA, letter, 1937 May 21, to Hamlin Garland. "We are much excited about your last postal." -- first line.
DOI: 10.25549/gar-c81-34662
title: Stewart Edward White, letter, 1936-05-18, to Hamlin Garland

description: Stewart Edward White, Little Hill, Burlingame, California, USA, letter, 1936 May 18, to Hamlin Garland. "Thanks for the inscribed copy: it is of course infinitely more valuable to me than a mere 'compliment of the pulbishers'." -- first line.
DOI: 10.5281/zenodo.14802776
title: NOS

description: NOS: A Dataset for Focusability in UI Accessibility Addressing the Non-accessible, Over-accessible, and Selective-accessible issues.
DOI: 10.25549/gar-c81-35186
title: William Allen White, letter, 1932-11-03, to Hamlin Garland

description: William Allen White (The Emporia Gazette), Emporia, Kansas, USA, letter, 1932 November 3, to Hamlin Garland, 2045 De Mille Drive, [Laughlin Park], Hollywood, Los Angeles, California, USA. "Here is a letter from Wm. [William] Mayo." -- first line.
DOI: 10.5281/zenodo.14802775
title: NOS

description: NOS: A Dataset for Focusability in UI Accessibility Addressing the Non-accessible, Over-accessible, and Selective-accessible issues.
DOI: 10.25549/gar-c81-35163
title: Stewart Edward White, letter, 1931-12-31, to Hamlin Garland

description: Stewart Edward White, Little Hill, Burlingame, California, USA, letter, 1931 December 31, to Hamlin Garland, 2045 De Mille Drive, [Laughlin Park], Hollywood, Los Angeles, California, USA. "I haven't answered your letter of December 19 for, -- I should say --, three reasons: first the holidays and what they imply; second, a rotton bad cold; and third, that I have not been able to relinquish work for either of the former considerations." -- first line. With typed transcription.
DOI: 10.25549/gar-c81-26068
title: Augustus Frederick Nightingale, letter, 1917-12-10, to Hamlin Garland

description: Augustus Frederick Nightingale, 916 Sheridan Road, Evanston, Illinois, USA, letter, 1917 December 10, to Hamlin Garland (MacMillan Company), . "I was a native of Roseton and went West at the age of 22 1/2 in '66 [1866]…" -- first line.
DOI: 10.25549/gar-c81-26002
title: Charles Gilman Norris, letter, 1914-04-04, to Hamlin Garland

description: Charles Gilman Norris, 106 Bible House, New York, New York, USA, letter, 1914 April 4, to Hamlin Garland (The Cliff Dwellers), 168 South Michigan Avenue, Chicago, Illinois, USA. "I know your affection for my brother, Frank Norris, I am, therefore, taking the liberty of sending you an advance copy of 'Vandover and the Brute' an earlier novel by him which has never been published." -- first line.
DOI: 10.5281/zenodo.17561285
title: Swedish word2vec embeddings trained on OpenSubtitles Part 3

description: This dataset contains the subs2vec embeddings for Swedish, as presented in https://zenodo.org/records/17243814. The embeddings were trained on large-scale subtitle corpora and represent semantic vector spaces derived from naturalistic language use in films and television from the OpenSubtitles 2018 datasets: https://opus.nlpl.eu/OpenSubtitles/corpus/version/OpenSubtitles.

For this language, we provide all embedding variants explored in the study. Specifically, the dataset includes vectors generated under different combinations of:





Dimensionality: multiple vector sizes (e.g., 100, 200, 300, …)




Window size: varying context windows (e.g., 2, 5, 10, …)




Each file corresponds to a unique configuration (dimension × window size). 



Each file contains the vocabulary for that language (column 1) and then the embedding values (columns 2 through dimension size + 1).

If you use this dataset, please cite:





Manuscript: https://doi.org/10.5281/zenodo.17243812 




Data: This Zenodo dataset (using the DOI provided here)
DOI: 10.5281/zenodo.17561284
title: Swedish word2vec embeddings trained on OpenSubtitles Part 3

description: This dataset contains the subs2vec embeddings for Swedish, as presented in https://zenodo.org/records/17243814. The embeddings were trained on large-scale subtitle corpora and represent semantic vector spaces derived from naturalistic language use in films and television from the OpenSubtitles 2018 datasets: https://opus.nlpl.eu/OpenSubtitles/corpus/version/OpenSubtitles.

For this language, we provide all embedding variants explored in the study. Specifically, the dataset includes vectors generated under different combinations of:





Dimensionality: multiple vector sizes (e.g., 100, 200, 300, …)




Window size: varying context windows (e.g., 2, 5, 10, …)




Each file corresponds to a unique configuration (dimension × window size). 



Each file contains the vocabulary for that language (column 1) and then the embedding values (columns 2 through dimension size + 1).

If you use this dataset, please cite:





Manuscript: https://doi.org/10.5281/zenodo.17243812 




Data: This Zenodo dataset (using the DOI provided here)
DOI: 10.25549/gar-c81-34852
title: Post Wheeler, letter, 1931-10-24, to Hamlin Garland

description: Post Wheeler (Legation of the United States of America), Asunción, Paraguay, letter, 1931 October 24, to Hamlin Garland, 507 Cathedral Parkway, New York, New York, USA. "When you wrote your letter of August 8th, I was just boarding the ship to return to this post." -- first line.
DOI: 10.25549/gar-c81-26009
title: Charles Gilman Norris, letter, 1924-01-04, to Hamlin Garland

description: Charles Gilman Norris, Sicily, Italy, letter, 1924 January 4, to Hamlin Garland . "How charming of your to write me so pleasantly about 'Bread'!" -- first line.
DOI: 10.25549/gar-c81-36615
title: William Allen White, letter, 1915-12-13, to Hamlin Garland

description: William Allen White (The Emporia Gazette), Emporia, Kansas, USA, letter, 1915 December 13, to Hamlin Garland, 6427 Greenwood Avenue, Chicago, Illinois, USA. "Collier's have a story of mine they bought not long ago." -- first line.
DOI: 10.25549/gar-c81-40225
title: William Dean Howells, letter, 1912-08-18, to Hamlin Garland

description: William Dean Howells, York Harbor, York, Maine, USA, letter, 1912 August 18, to Hamlin Garland, [357 West Garland Street [later named]], West Salem, Wisconsin, USA. "Your friends were delightful, and though my heart was all the time heavy for my dear old brother who has since died, I thoroughly enjoyed seeing them." -- first line. With envelope. With typed transcription.
DOI: 10.25549/gar-c81-35125
title: William Allen White, letter, 1934-08-10, to Hamlin Garland

description: William Allen White (The Emporia Gazette), Emporia, Kansas, USA, letter, 1934 August 10, to Hamlin Garland, 2045 De Mille Drive, [Laughlin Park], Hollywood, Los Angeles, California, USA. "This is an old-fashioned scorcher; our fifty-fifth day with temperature above a hundred and nearly two weeks with temperature above 110." -- first line.