SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Q9: {"title question": "Excel: how to adjust range in pivot table automatically?", "top answer": "First, turn your data table into an Excel Table object: Select any cell in the source range, then click Insert >Table or keyboard shortcut Ctrl..."}
Q10: {"question title":"Create a pie chart from distinct values in one column by grouping data in Excel", "top answer":"This is how I do it:
1. Add a column and fill it with 1 (name it Count for example). 2. Select your data (both columns) and create a Pivot Table: On the Insert tab click on the PivotTable! Pivot Table (you can create it on the same worksheet or on a new sheet)...
Q11: {"question title":"How to Change Orientation of Multi-Level Labels in a Vertical Excel Chart?","top answer":"You can only control the alignment of the inner most set of multi-level axis labels. Except when you add a data table to the chart, then you have no
control over the alignment. One thing you can consider is to turn off the multi-level category option:"}
Q12: {"question title":"Create PDF with internal hyperlinks","top answer":""}
Q13: {"question title":"What does the TABLE function do?", "top answer":""}
Q14: { "question title":How do you create a report in Word (or other documentation software) that is directed directly with Excel 2007 data?", "top answer":"} Exemplar classification results consist of the category labels and involved atomic actions of each Q&A pair
Q1: {"category":"B", "atomic actions":"Filter"}
Q2: {"category":"B, D", "atomic actions": "Sort, Statistic functions, Lookup and reference functions"}
Q3: {"category":"A", "atomic actions":"Delete rows"}
Q4: {"category":"A", "atomic actions":"Cut-paste, Insert rows"}
Q5: {"category":"C", "atomic actions":"Conditional formatting"}
Q6: {"category":"C", "atomic actions":"Resize cells"}
Q7: {"category":"D", "atomic actions":"Math functions"}
Q8: {"category":"D", "atomic actions":"Date and time functions"}
Q9: {"category":"F,A","atomic actions":"Create Pivot Tables,Insert rows"}
Q10: {"category":"A, F, E", "atomic actions":"Insert columns, Create Pivot Tables, Create Pivot Charts"}
Q11: {"category":"E", "atomic actions":"Change axis label"}
Q12: {"category": "Invalid", "atomic actions": None}
Q13: {"category":"Invalid", "atomic actions":None}
Q14: {"category":"Invalid", "atomic actions":None}
(Q&A pairs to be classified)
Please process the questions below and give results in the same form as the examples above.
Q1: {"question title": "SUM column C unless value in col A matches col B", "top answer": "You can use the following, entered an as array formula with CTRL+SHIFT+ENTER:=SUM(IF(COUNTIF(B1:B7,A1:A7)=0,C1:C7))"}
Q2: {"question title": "Word paste table from Excel has marks instead of values", "top answer": "Cause: The column is "too narrow" to allow showing the content, according to Word. Remedy: Move the mouse pointer slowly horizontally over the column border and it will change shape at some point ..."
Q3: {"question title":"According to  $4^{\wedge}3^{\wedge}2 = (4^{\wedge}3)^{\wedge}2$ . Is this really the standard mathematical convention for the order of exponentiation?", "top answer":"Your teacher is right. According to standard rules of algebra exponents are solved from right to left, therefore ..."}
(GPT-3.5 response)
Q1: {"category":"A, D", "atomic actions": "Update cell value, Math functions"}
Q2: {"category":"C", "atomic actions":" Formatting cells"}
Q3: {"category":"Invalid","atomic actions":None}
Table C: An example of using the adaptation prompt to adapt the seed tasks. For clarity, the prompt components and an example GPT-4 response are marked with brief descriptions in blue.
(Requirements for adaptation)
As an Excel expert, you have been assigned the responsibility of adapting a set of task instructions for specific Excel workbooks. These instructions will be utilized to evaluate the Excel manipulation capabilities of large language models.
1. First, identify individual atomic actions used in the original instructions, then develop new instructions incorporating these actions.
2. Use the detailed descriptions of the provided workbooks to modify the original instructions so that they become compatible with the workbooks. Specifically, you must change the manipulated objects (ranges, sheets, rows, and columns) in the original instructions. You must also change the way you use atomic actions. For instance, if the original instruction sets the data type as accounting, you can change it to other types in the adaptation.
3. Use standard range references, such as 'Sheet2!A1:C9', 'A2:E16', 'A:H', column C, or row 16.
4. Use different phrasing (e.g., various sentence structures and noun/verb forms) to create diverse instructions.
5. Apply domain-specific knowledge to diversify the generated instructions. For instance, use financial knowledge to calculate various metrics, demonstrate trends in product sales from different perspectives, visualize data using various types of charts, and so on.
6. (Important!) The generated instructions must describe realistic tasks and involve the normal use of atomic actions according to the workbook descriptions.
7. In every new instruction, new tables and Pivot tables must be created in a new worksheet and start from A1. Only one new sheet is allowed to be created. Besides, the headers of new columns/rows and the names of new sheets must be set.
8. The instructions after adaptation should look like what a non-expert Excel user would say and should not mention any specific functions or operations built in Excel. (Available atomic actions used to label the adaptation results)
Here are the atomic actions you can identify within the six categories:
A. Entry and manipulation: Update cell value, Delete, Split text to columns, Insert row, Insert column, Autofill, Copy-paste, Copy-paste format, Copy sheet, Cut-paste, Find and replace, Set hyperlink, Delete hyperlink, Remove duplicates, Rename sheets, Insert checkbox, Insert textbox, Create sheet, Delete sheet, Clear
B. Management: Switch sheet, Sort, Filter, Delete filter, Slicer, Move rows, Move columns, Group, Ungroup, Hide rows, Hide columns, Unhide rows, Unhide columns, Hide sheet, Unhide sheet, Set password, Transpose, Create named range, Delete named range, Data consolidation, Freeze pages, Unfreeze pages, Split pages
C. Formating: Format cells, Set data type, Delete format, Merge cells, Unmerge, Change page layout, Set border, Resize cells, Conditional formatting, Lock and unlock, Protect, Unprotect, Drop-down list, Data validation, Insert checkbox, Display formulas, Wrap text, Unwrap text, Autofit
D. Charts: Create chart, Create Pivot Chart, Set chart title, Set chart axis, Set chart has axis, Set chart legend, Set chart color, Set chart source, Set chart marker, Resize chart, Set trend line, Add data labels, ... (leave out for clarity)
E. Pivot Table: Create Pivot Table, Remove Pivot Table, Set summary type, Sort Pivot Table
F. Formula: Date and time functions, Logical functions, Lookup and reference functions, Math functions, Statistical functions, Text functions, Financial functions
Restrictions for the atomic action parameters:
Chart type can only be (stacked/clustered) column chart, (stacked/clustered) bar chart, (3D) pie chart, line chart (with smooth lines), (stacked) area chart, or scatter chart. Cell value type can only be date, text, time, currency, percentage, number, or general.
I will give you an example first:
(Adaptation exemplars written by the authors)
Given an Excel workbook:
The sheet 'Sheet1' records the employee working hours of a coffee shop. It has 8 columns (Headers are: A: "location", B: "name", C: "date", D: "hours", E: "ot hours", F: "base pay", G: "ot pay", H: "total pay") and 11 rows (including the header row). The cells in the "location" column can be "capitol hill", "queen anne". The cells in the "name" column can be "Aaron", "Bob", "Blanca", "Frank".
The original instructions to be adapted:
1. I'd like to know if there's a formula (or combination of formulas) to sum Column B ONLY if it equals Column A?
2. Column A contains multiple due dates and cell B1 is 10/31/2022. Append a special character to the cells in column A depending on whether the due date is less or more than the date in B1. If neither applies, leave the cell unchanged.
3. Create a Pivot Table to separate dates by each month similar to the quarterly function. This will show all dates in the last year under the column label. Choose the monthly option under data filters in the columns label under data filters.
4. Freeze A1:B10 so that no matter how I scroll vertically or horizontally this range is always frozen.
5. I have five groups of data each occupying two columns. I'd like to have them plotted all on one bar chart but with the series separated (i.e., not clustered) so that several column charts stick together sharing the same y-axis.
Adaptations compatible with the given workbook (Show the categories involved in the generated instruction and list the atomic actions following the category label):
1. Instruction: In a new column with header "Total pay each location", use a formula to sum the "total pay" (Column H) for each employee ONLY if their "location" (Column A) is "capitol hill". - Categories (atomic actions): A (Update cell value); F (Math functions)
2. Instruction: Create a formula in a new column (Column I) with header "Marked Due Dates" to check if the dates in column C are less or more than 10/31/2022. If the date is less, append a '-' to the cell in the same row in column C; if the date is more, append a '+'; otherwise, leave the cell unchanged. - Categories (atomic actions): A (Update cell value, Autofill); F (Logical functions, Text functions)
3. Instruction: Create a Pivot Table in a new sheet named "Sheet2" based on the data in 'Sheet1' and then summarize sum of hours for each location in this Pivot Table. Categories (atomic actions): A (Create sheet); E (Create Pivot Table)
4. Instruction: Freeze the range A1:H1 so that the headers remain visible when scrolling vertically or horizontally. - Categories (atomic actions): C (Freeze panes)
5. Instruction: Create a Pivot Table in a new sheet named "Sheet2" to sum the hours for all dates and then plot a line chart to show the trend of hours changing with dates. - Categories (atomic actions): A (Create sheet); E (Create Pivot Table); D (Create chart)
(Seed tasks to be adapted)
Now it's your turn
My workbo records inf f 14 rows (inuding the header row). The cells in the "Respondents" column range from 1.00 to 40.00. The cells in the "Sex" column can be "Male", "Female". The cells in the "Civil Status" column can be "Single", "Widow", "Married". The cells in the "Highest Educational Attainment" column can be "Elementary", "Senior High School", "Junior High School".
1. I'd like to know if there's a formula (or combination of formulas) to sum Column B ONLY if it equals Column A.
2. I have a sheet 1 with 3 columns as shown below. I have another sheet named Sheet 2 with only the first names in Column A in Sheet 1. I would like to write a formula in column B of Sheet 2 which matches the first name in Column A of Sheet 2 against the first name in Column A of Sheet 1. If "no" is found in column C of Sheet 1 then copy the information in column B of Sheet 1 to column B of Sheet 2.
Adaptations compatible with the given workbook (Show the categories involved in the generated instruction and list the atomic actions following the category label): (GPT-4 response)
Instruction: Can we find out if there's a formula (or a combination of them) that sums up all values in the "Highest Educational Attainment" column (Column D) ONLY if the "Sex" is "Male" (Column B)? Categories (atomic actions): A (Update cell value); F (Math functions, Logical functions)
Instruction: In a new column (Column E) named "Gender-Match Education", find if the "Sex" in column B matches the "Highest Educational Attainment" in Column D. If there's a match, copy the corresponding "Civil Status" from Column C to Column E. - Categories (atomic actions): A (Insert column, Update cell value, Autofil); F (Lookup and reference functions)
Figure B: Left: The proportions of the six categories. Right: Diversity of the verb-noun phrases in the core set. We demonstrate the diversity of the core set by showing the top 10 most frequent root verbs (the inner circle) and their direct noun objects (the outer circle) in the instructions.
Figure C: The distribution of the category combinations.
Table D: Adaptation examples. The adaptations show that using the proposed prompt, GPT-4 is able to adapt the seed tasks for the evaluation sheet by changing the operated sheet elements and use of the atomic actions.
Seed tasks	Adaptations
· Count the number of values that appear more than once in column A.	· In a new cell, count the number of "Product" (Column C) values in 'Sheet1' that appear more than once.
· Add leading zeros to every number in column A then append them to the texts in column B.	· In a new sheet named "Sheet2", format the years in column A from "Sheet1" as text and append the corresponding Gross Profit value (Column J) from "Sheet1".
· Apply conditional formatting in a column based on two other columns. If the cell value in column C is not 'End' and the cell value in column D is empty, the value in column A is displayed in red.	· Apply conditional formatting to cells in column A based on the cell value in column B. If the value in A is greater than the value in B, display the value in column A in red.
· I have five groups of data each occupying two columns. I'd like to have them plotted all on one bar chart but with the series separated so that several column charts stuck together that share the same y-axis.	· Create a Pivot Table in a new sheet named "Sheet2" to show the sum of distances for each customer to each destination, and then create a clustered bar chart to represent the distances for each destination on the same y-axis.
Table E: Simplification examples. The simplification results demonstrate three features: (1) using brief and clear references to operated ranges; (2) expressing the intention with spoken language instead of directly mentioning Excel built-in functions; (3) considerably reducing the sentence length.
Adaptations	Simplification Results
Calculate the sum of "Quantity" (Column E) in 'Sheet1' ONLY if the "Product" (Column C) in 'Sheet1' matches the "Product" (Column A) in 'Retail Price' sheet.
In a new sheet named "Sheet3", use INDEX and MATCH to retrieve sales information from "Sheet1" based on the row IDs provided in a list on another sheet.
In a column (Column H) with header "Days from Today", calculate the number of days difference between the "Date" (Column A) and today's date.	Find the total quantity sold for each product listed in the 'Retail Price' sheet.
Retrieve sales information based on row IDs listed on another sheet and display the results on a new sheet named "Sheet3".
Calculate the number of days between today and the "Date" column in a new column named "Days from Today."
Figure D: Statistics of the subset used for comparing the LLMs.
Figure E: The complete state machine for task planning. The transfer condition (orange texts with brackets) must be fulfilled before performing the corresponding operation (green texts) to transfer to a next state.
Table F: An example of using the verification prompt to classify the adapted tasks. For clarity, the prompt components and the GPT-3.5 response are marked with brief descriptions in blue and the redundant contents are substituted with ellipsis.
(Requirements for verification)
I will give you a batch of Excel task instructions that are utilized to evaluate the spreadsheet manipulation capabilities of large language models. Please check all instructions according to the criteria and the descriptions of the given workbooks.
1. If an instruction fulfills all of the following four criteria strictly at the same time, it is valid.
A. Realism: Verify that the instructions are representative of real-world Excel problems encountered by expert users. Avoid including contrived or overly complex tasks that would rarely be encountered in practice.
B. Relevance: Verify that the instructions are relevant to the context of the given workbooks. Reject instructions that do not relate to the content of the workbooks or are not applicable in the context of Excel.
C. Clarity: Verify that the instructions are clear and easy to understand. They should be free from grammatical errors and ambiguities.
D. Completeness: Verify that the instructions can be completed using the provided workbook data and Excel features. If additional data or functionality is needed to accomplish a task, reject the instruction.
2. Use your domain-specific knowledge to reason and make decisions. For example, it is unlikely to calculate monthly or yearly averages of some physical values because this task is impractical.
(Exemplars for verification. The sheet description is provided to more accurately verify the fulfillment of the four criteria)
My workbook records many invoices made on different dates. Sheet "Sheet1" has 7 columns (Headers are A: "No," B: "Date", C: "Salesman", D: "Product", E: "Price", F: "Units", G: "Sales") and 19 rows (including the header row). The cells in the "No," column range from 10500.00 to 10505.00. The cells in the "Date" column can be "2011-05-28 00:00:00", "2011-05-25 00:00:00", "2011-05-27 00:00:00". The cells in the "Salesman" column can be "Joe", "Chin", "Moe". The cells in the "Product" column can be "Quad", "Majestic", "Bellen", "Carlota", "Alpine". The cells in the "Price" column range from 22.00 to 32.00. The cells in the "Units" column range from 4.00 to 25.00. The cells in the "Sales" column range from 128.00 to 750.00.
Instructions to check:
1. Find the sales value corresponding to each No. in a new column called "Invoice Lookup".
2. Compare the names in the Salesman column to find the closest match for each name. Put the results in a new column named "Salesman Matched".
3. Create a sheet named "Sheet2" to summarize the total sales for each sales representative in Sheet1.
4. Prepend leading zeros to each number in the "No." column so that they have a fixed length of 6 digits. Append the new results to the corresponding product names in the "Product" column, and put the results in a new column named "Padded No."
5. Find the corresponding date for each No. in a new column named "Lookup Date" in Sheet1.
6. Find and display the row values in Sheet1 based on the "No." column. Put the results in a new sheet named "Sheet2".
7. Round the values in the "Sales" column to two decimal places in a new column named "Rounded Sales", and display the results with trailing zeros.
8. Merge cells A1 through C1 with cells A2 through D2.
9. Add hyperlinks to each cell in the "No." column that link to its corresponding file.
Check results (Give brief reasons in the comments and tell me if the instruction is valid):
1. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction fulfills the 4 criteria, so it is valid.
2. Realism: No, Relevance: No, Clarity: No, Completeness: No. Comment: This instruction is unrealistic and unclear and does not seem to be relevant to the context of the given workbook, so it is invalid.
3. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction fulfills the 4 criteria, so it is valid.
4. Realism: No, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction appends numbers to product names, which is not a realistic requirement, so it is invalid.
5. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction fulfills the 4 criteria, so it is valid.
6. Realism: Yes, Relevance: Yes, Clarity: No, Completeness: No. Comment: The instruction does not specify what values to display, so it is invalid.
7. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction fulfills the 4 criteria, so it is valid.
8. Realism: No, Relevance: No, Clarity: Yes, Completeness: Yes. Comment: The instruction merges cells, which destroys the original data and is meaningless in the context of the workbook, so it is invalid.
9. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: No. Comment: The instruction does not refer to specific corresponding files, which is incomplete, so it is invalid.
(Instructions to be verified)
My work records all aspects of expenses but has not yet been completed. The necessary formulas are as follows: Tax = Subtotal * Tax rate; Total = Subtotal + Tax. Sheet "Sheet1" has 6 columns (Headers are A: "Date", B: "Vendor/Client", C: "Expense Account", D: "Subtotal", E: "Tax", F: "Total") and 25 rows (including the header row). The cells in the "Date" column can be "2020-01-06 00:00:00", "2020-01-08 00:00:00", "2019-12-27 00:00:00", ..., The cells in the "Vendor/Client" column can be "Company A", "Company B", "Client B", "Client A". The cells in the "Expense Account" column can be "Material Purchase", "Meals", "Hiring", "Gas", "Car Repairs", "Reception", "Accommodation", "Flight tickets". The cells in the "Subtotal" column range from 127.00 to 1954.00.
1. Calculate the sum of the Subtotal column only for the rows that have "Company A" in the Vendor/Client column.
2. For each row in Sheet2, find its matching row in Sheet1, and if the Expense Account is "Accommodation", copy the Subtotal to column B of Sheet2.
3. Calculate the tax by multiplying the Subtotal column by 0.1 and write the results in a new column with the header "Tax Calculation".
4. Calculate the number of days between each date in the Date column and the current date. Write the results in a new column with the header "Days Since Expense".
5. Count the number of Vendor/Client values that appear more than once in the data.
6. For each row, subtract the Expense Account's first three characters from the Subtotal and put the result in a new column named "Adjusted Subtotal"
1. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction fulfills the 4 criteria, so it is valid.
2. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction specifies a matching condition and copying of data based on that condition, so it is valid.
3. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction calculates tax based on the Subtotal column, so it is valid.
4. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction calculates the number of days between dates, which is a practical task, so it is valid.
5. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction requires counting the number of duplicate values, which is a common
task, so it is valid.
6. Realism: Yes, Relevance: Yes, Clarity: Yes, Completeness: Yes. Comment: The instruction specifies a calculation based on the Expense Account column, so it is valid.
Table G: An example of using the simplification prompt to rephrase overly specific task instructions. For clarity, the prompt components and an example ChatGPT response are marked with brief descriptions in blue and the redundant contents are substituted with ellipsis.
(Requirements for simplification)
You have been tasked with paraphrasing a set of instructions for Excel tasks.