Robust (Controlled) Table-to-Text Generation with Structure-Aware Equivariance Learning
Abstract
Controlled table-to-text generation seeks to generate natural language descriptions for highlighted subparts of a table.
Previous SOTA systems still employ a sequence-to-sequence generation method, which merely captures the table as a linear structure and is brittle when table layouts change.
We seek to go beyond this paradigm by (1) effectively expressing the relations of content pieces in the table, and (2) making our model robust to content-invariant structural transformations.
Accordingly, we propose an equivariance learning framework,
L ATTICE ( ), which encodes tables with a structure-aware self-attention mechanism.
This prunes the full self-attention structure into an order-invariant graph attention that captures the connected graph structure of cells belonging to the same row or column, and it differentiates between relevant cells and irrelevant cells from the structural perspective.
Our framework also modifies the positional encoding mechanism to preserve the relative position of tokens in the same cell but enforce position invariance among different cells.
Our technology is free to be plugged into existing table-to-text generation models, and has improved T5-based models to offer better performance on ToTTo and
HiTab.
Moreover, on a harder version of ToTTo, we preserve promising performance, while previous SOTA systems, even with transformationbased data augmentation, have seen significant performance drops.
Introduction
Table-to-text generation seeks to generate natural language descriptions for content and entailed conclusions in tables.
It is an important task that not only makes ubiquitous tabular data more discoverable and accessible, but also supports downstream tasks of tabular semantic retrieval (Wang et al., 2021a), reasoning (Gupta et al., 2020), fact
[Figure]
checking (Chen et al., 2019;
Wang et al., 2021b) and table-assisted question answering (Chen et al., 2020c).
While rich and diverse facts can be presented in a table, the controlled table-to-text generation task, which generates focused textual descriptions for highlighted subparts of a table, has garnered much attention recently (Parikh et al., 2020;
Kale and Rastogi, 2020; Cheng et al., 2022).
Prior studies on controlled table-to-text generation often employ a sequence-to-sequence generation method, which merely captures the table as a linear structure (Parikh et al., 2020; Kale and
Rastogi, 2020; Su et al., 2021).
However, table layouts, though overlooked by prior studies, are key to the generation from two perspectives.
First, table layouts indicate the relations among cells that collectively present a fact, which are however not simply captured by a linearized table.
For example, if we linearize the first table row-wise in Fig. 1,
Wai Siu-bo will be next to both Royal Tramp and
King of Beggers , so that it is not clear this role belongs to which film.
Second, the same content can be equivalently expressed in tables with different layouts.
While linearization simplifies the layout representation, it causes brittle generation when table layouts change.
Fig.
1 shows two tables with the same content but different layouts, for which the generations by T5 are largely inconsistent.
In this paper, we focus on improving controlled table-to-text generation systems by incorporating two properties: structure-awareness and transformation-invariance .
Structure-awareness, which seeks to understand cell relations indicated by the table structure, is essential for capturing contextualized cell information.
Transformationinvariance, which seeks to make the model insensitive to content-invariant structural transformations (including transpose, row shuffle and column shuffle), is essential for model robustness.
However, incorporating structure-awareness and transformation-invariance into existing generative neural networks is nontrivial, especially when preserving the generation ability of pretrained models as much as possible.
We enforce the awareness of table layouts and robustness to content-invariant structural transformations on pretrained generative models with an equivariance learning framework, namely Layout Aware and TransformaTion
Invariant Controlled Table-to-Text GEneration (L ATTICE ).
L ATTICE encodes tables with a transformation-invariant graph masking technology.
This prunes the full self-attention structure into an order-invariant graph-based attention that captures the connected graph of cells belonging to the same row or column, and differentiates between relevant cells and irrelevant cells from the structural perspective.
L ATTICE also modifies the positional encoding mechanism to preserve the relative position of tokens within the same cell but enforces position invariance among different cells.
Our technology is free to be plugged into existing table-to-text generation models, and has improved T5-based models (Raffel et al., 2020) on ToTTo (Parikh et al., 2020) and HiTab (Cheng et al., 2022).
Moreover, on a harder version of ToTTo, we preserve promising performance, while previous SOTA systems, even with transformation-based data augmentation, have seen significant performance drops.
Our contributions are three-fold.
First, we propose two essential properties of a precise and robust controlled table-to-text generation system, i.e. structure-awareness and transformation-invariance.
Second, we demonstrate how our transformationinvariant graph masking technology can enforce these two properties, and effectively enhance a representative group of Transformer-based generative models, i.e. T5-based models, for more generalizable and accurate generation.
Third, in addition to experiments on ToTTo and HiTab benchmarks, we evaluate our model on a harder version of ToTTo with a special focus on robustness to content-invariant structural transformations.
Method
In this section, we first describe the preliminaries of content-invariant table transformations, base models and the input format for controlled table-to-text generation (§2.1).
Then we introduce the technical details about how the transformation-invariant graph masking technology in L ATTICE enforces the model to be structure-aware and transformationinvariant (§2.2).
Finally, we present two alternative techniques for strengthening the transformationinvariance to be compared with L ATTICE (§2.3).
2. Preliminaries
Content-Invariant Table Transformations.
Tables organize and present information by rows and columns.
A piece of information is presented in a cell (with headers), which is the basic unit of a table.
Rows and columns are high-level units indicating relations among cells, and are combined to express more comprehensive information.
We discuss two categories of transformations that may be made on a table, as shown in Fig.
First, contentvariant transformations modify or exchange a part of cells in different rows or columns, therefore changing the semantics of the table.
In such cases, new tabular content are created to express information being inconsistent with the original table.
Second, content-invariant transformations consist of operations that do not influence content within (combinations of) the same row or column, resulting in semantically equal (sub-)tables.
Specifically, such operations include transpose, row shuffle and column shuffle.
By performing any or a combination of such operations, we can present the same information in different table layouts.
Base Models.
Pretrained Transformer-based generative models achieve SOTA performance on various text generation tasks (Raffel et al., 2020; Lewis et al., 2020).
In order to adapt this kind of models to table-to-text generation, prior works propose to linearize the table into a textual sequence (Kale and
Rastogi, 2020; Chen et al., 2020b; Su et al., 2021).
Our method L ATTICE is model-agnostic and can be incorporated into any such models.
Following Kale and Rastogi (2020), we choose a family of the best performing models, T5 (Raffel et al., 2020), as our base models.
Models of this family are jointly pretrained on a series of supervised and self-supervised text-to-text tasks.
Models can switch between different tasks by prepending a task-specific prefix to the input.
Our experiments (§3.3 and §3.4) point out that base models are brittle to content-invariant table transformations and can only capture limited layout information.
Input Format.
Prior works (Kale and Rastogi, 2020; Chen et al., 2020b; Su et al., 2021) linearize indexes.
The input sequence often starts with the metadata of a table, such as page title and section title.
Then, it traverses the table row-wise from the top-left cell to the bottom-right cell.
Headers of each cell can be either treated as individual cells or appended to the cell content.
Each metadata/cell/header field is separated with special tokens.
This linearization process suits the input to text-to-text generation models, yet discards much of the structural information of a table (e.g., two cells in the same column can be separated by irrelevant cells in the sequence, while the last cell and first cell in adjacent rows can be adjacent although they are irrelevant), and is sensitive to content-invariant table transformations.
2. Transformation-Invariant Graph
Masking
L ATTICE realizes equivariance learning by modifying the Transformer encoder architecture.
It also improves the base model’s ability of capturing structures of highlighted tabular content.
Specifically, we incorporate a structure-aware selfattention mechanism and a transformation invariant positional encoding mechanism in the base model
The workflow is shown in Fig.
Structure-Aware Self-Attention.
Transformer (Vaswani et al., 2017) adopts self-attention to aggregate information from all the tokens in the input sequence.
The attention flows form a complete graph connecting each token.
This mechanism works well for modeling sequences but falls short of capturing tabular structures.
The non-linear layout structure reflects semantic relations among cells, hence should be captured by self-attention.
We incorporate structural information by pruning the attention flows.
According to the nature of information arrangement in a table, two cells in neither the same row nor the same column are not semantically related, or at least the combination of them do not directly express information this table seeks to convey.
Intuitively, representations of these cells should not directly pass information to each other.
In L ATTICE , attention flows among tokens of structurally unrelated cells are removed from the attention graph, while those within the metadata, within each cell, and between metadata and each cell are preserved.
In this way, we also
Invariant Position
L ATTICE
Pij=|i-j|
Pij=Pmax
Year
Title
Role
Justice,
My Foot!
Sung Sai
Kit
Royal
Tramp
Wai
Siu-bo
Year
Title
Role
Justice,
My Foot!
Sung Sai
Kit
Royal
Tramp
Wai
Siu-bo
Year
Title
Role
Justice,
My Foot!
Sung Sai
Kit
Royal
Tramp
Wai
Siu-bo
[Figure]
Structural
Attention ensure the transformation-invariance property of the self-attention mechanism, since related cells in the same row or same column are all linked in an unordered way in the attention graph.
It is easy to show that for any individual cell, the links in the attention graph will remain the same after any content-invariant operations (§2.1) are applied.
Transformation-Invariant Positional Encoding.
When calculating the attention scores between each pair of tokens, the base model captures their relative position in the sequence of linearized table as an influential feature.
Specifically, the attention flow from the i -th token to the j -th token is paired with a relative position P ij = | i − j | .
This easily causes positional biases among distinct cells, since the relative positions in the sequence do not fully reflect relations among cells in the table.
Moreover, the relative position between the same token pair will change as the table layout change, which is the source of inconsistent generation shown in Fig.
As discussed in §2.1, for a given cell, its relations with other cells in the same row or column should be equally considered.
It is natural to assign the same relative positions among (tokens of) cells in the same row or column, no matter how far their distance is in the linear sequence.
Meanwhile, we preserve the relative positions of tokens inside the same cell (or the metadata).
Specifically, the relative position between the i -th token and the j -th token in the input sequence is
[Equation]
the same
[Equation]
where “same field” means the two tokens are from the same cell or both of them are from the metadata, and P max is the max relative position allowed.
As a result, L ATTICE represents cells (and the metadata) in a way that is invariant to their relative positions in the sequence.
As content-invariant table transformations do not change the relations among cells in the table (i.e. whether two cells are from the same row or column), this positional encoding mechanism is transformation-invariant.
Training and Inference.
After obtaining the structure-aware and transformation-invariant table representation, L ATTICE conducts similar training and inference as the base model.
Given the linearized table T i , its layout structure S i , and target sentence Y i
=
{ y i 1 , y i 2 , ..., y in i } , training minimizes the negative log-likelihood.
For a dataset (or batch) with N samples, the loss function is
[Equation]
During inference, the model generates a sentence token by token, where each time it outputs a distribution over a vocabulary.
2. Alternative Techniques
In addition to the equivariance learning realized by tranformation-invariant graph masking, we present and compare with two alternative techniques.
Layout-Agnostic Input.
The first technique is to adjust input sequences to be invariant to contentinvariant table transformations.
A simple way is to reorder headers and cells by an arbitrary order not based on table layouts (e.g., lexicographic order) to form a sequence.
Special tokens to separate cells and headers should also include no layout information 3 .
As a result, this input format loses all information about table layouts to ensure transformation-invariance.
Data Augmentation.
The second technique is data augmentation by content-invariant table transformation.
This technique augment tables with different layouts to training data, seeking to enhance the robustness of the base model by exposing it to more diverse training instances.
Our experiments systematically compares these two techniques with tranformation-invariant graph masking in §3.3, revealing how directly performing equivariance learning from the perspective of neural network structure leads to better performance and robustness than using layout-agnostic input or data augmentation.
Experiments
In this section, we conduct experiments on two benchmark datasets.
First, we introduce the details of datasets, baselines, evaluation metrics and our implementation (§3.1).
Then, we show the overall performance of L ATTICE (§3.2).
After that, we analyze the model robustness on a harder version of the ToTTo dataset where content-invariant perturbations are introduced (§3.3).
Finally, we provide ablation study on components of transformationinvariant graph masking (§3.4).
Experimental Settings
Datasets.
We evaluate our model on ToTTo (Parikh et al., 2020) and HiTab (Cheng et al., 2022) benchmarks.
Details of them are described as follows:
• ToTTo: An English dataset released under the Apache License v2.0.
The dataset is dedicated to controlled table-to-text generation.
It consists of 83,141 Wikipedia tables, 120,761/7,700/7, sentences (i.e. descriptions of tabular data) for train/dev/test.
Target sentences in test set are not publicly available.
Each sentence is paired with a set of highlighted cells in a table, and each table has metadata including its page title and section title.
The dev and test sets can be further split into 2 subsets, i.e. overlap and non-overlap, according to whether the table exists in the training set.
• HiTab: An English dataset released under
Microsoft’s Computational Use of Data Agreement (C-UDA).
It is intended for both controlled tableto-text generation and table-based question answering with a special focus on hierarchical tables.
It contains 3,597 tables, including tables from statistical reports and Wikipedia, forming 10,686 samples distributed across train (70%), dev (15%), and test (15%).
Each sample consists of a target sentence and a table with highlighted cells and hierarchical headers.
Evaluation Metrics.
We adopt three widely used evaluation metrics for text generation.
BLEU (Papineni et al., 2002) is one of the most common metric for text generation based on n -gram cooccurrence.
We use the commonly used BLEUfollowing prior works (Parikh et al., 2020; Cheng et al., 2022).
PARENT (Dhingra et al., 2019) is a metric for data-to-text evaluation taking both references and tables into account.
BLEURT (Sellam et al., 2020) is a learned evaluation metric for text generation based on BERT (Devlin et al., 2019).
Following prior studies (Parikh et al., 2020; Cheng et al., 2022), we report all three metrics on ToTTo and the first two metrics on HiTab using the evaluation tool released by Parikh et al.
Baselines.
We present baseline results of the following representative methods:
• Pointer-Generator (Gehrmann et al., 2018):
An LSTM-based encoder-decoder model with attention and copy mechanism, first proposed by See et al.
(2017) for text summarization.
• BERT-to-BERT (Rothe et al., 2020):
A Transformer-based encoder-decoder model, where the encoder and decoder are initialized with BERT (Devlin et al., 2019).
• T5 (Kale and Rastogi, 2020):
A pretrained generation model first proposed by Raffel et al.
The model is Transformer-based, pretrained on text-to-text tasks, and finetuned on linearized tables to offer the previous SOTA performance.
All the baseline results on ToTTo can be found in the official leaderboard 4 , except for T5-small and T5-base, for which we reproduce the results on dev set reported by Kale and Rastogi (2020) and submit the predictions on hidden test set to the leaderboard.
For HiTab, we run T5 and L ATTICE using our replication of the linearization process introduced by Cheng et al.
Results of other baselines are from Cheng et al.
[Figure]
Implementation Details.
We adopt the pretrained model weights released by Raffel et al.
Specifically, we use T5-small and T5-base 6 .
For finetuning, we use a batch size of 8 and a constant learning rate of 2 e − 4 .
Following Kale and Rastogi (2020) and Cheng et al.
(2022), all input sequences are truncated to a length of 512 to accommodate the limit of the pretrained models.
L ATTICE does not add any parameters to the base model, so L ATTICE (T5-small) has 60 million parameters and L ATTICE (T5-base) has 220 million parameters, same as the base models.
For ToTTo, we use a beam size of 4 to generate sentences with at most 128 tokens.
For HiTab, we use a beam size of 5 to generate sentences with at most 60 tokens following Cheng et al.
Our implementation is based on Pytorch (Paszke et al., 2019) and Transformers (Wolf et al., 2020).
We run experiments on a commodity server with a GeForce RTX 2080 GPU.
It takes about 0.5 hour to train L ATTICE (T5-small) for 10, steps and about 1 hour to train L ATTICE (T5-base) for 10,000 steps.
Considering different sizes of two datasets, we train models for 150,000 steps on
ToTTo, and for 20,000 steps on HiTab.
Results of
L ATTICE on ToTTo dev set and HiTab are average of multiple runs.
For ToTTo test set, we report the results on official leaderboard.
As shown in Fig.
4, we use different input formats for ToTTo and Hitab following prior works (Kale and Rastogi, 2020; Cheng et al., 2022), since the tables and annotations in these two datasets are different.
For ToTTo, we follow the linearization procedure by Kale and Rastogi (2020).
Specifically, the textual sequence consists of the page title, section title, table headers and cells.
Each cell may be associated with multiple row and column headers.
Special markers are used to denote the begin and end of each field.
Different from Kale and
Rastogi (2020), we use the same markers for row headers and column headers.
For HiTab, we follow the linearization procedure of Cheng et al.
Specifically, the textual sequence consists of highlighted cells and headers, headers of highlighted cells, and cells belong to highlighted headers.
A universal separator token [SEP] is used.
While our model can achieve consistently the same performance with any ordering of inputs, we adopt the same lexicographic as the layout-agnostic input format (§2.3) to avoid uncertainty due to truncation and special markers.
3. Main Results
Tab. 1 shows model performance on ToTTo test set.
Among the baselines, methods based on pretrained
Transformer models (i.e. BERT-to-BERT and T5) outperform the others and T5 models perform the best.
Our method L ATTICE can be plugged into such models.
We compare our method with pure
T5 models of different sizes, and L ATTICE consistently performs better.
Overall, L ATTICE (T5small) achieves improvements of 2.1 BLEU points and 0.8 PARENT points in comparison with T5small, and L ATTICE (T5-base) achieves improvements of 1.0 BLEU points and 1.7 PARENT points in comparison with T5-base.
These results indicate the importance of structure information, which is almost totally abandoned by baselines.
Further, the performance gain on tables both seen and unseen during training are significant.
Specifically, on the overlap subset, L ATTICE (T5-small) achieves improvements of 2.9 BLEU points and 1.3 PARENT points, and L ATTICE (T5-base) achieves improvements of 0.9 BLEU points and 1.3 PARENT points, indicating better intrinsic performance.
On the nonoverlap subset, L ATTICE (T5-small) achieves improvements of 1.3 BLEU points and 1.0 PARENT points, and L ATTICE (T5-base) achieves improvements of 1.3 BLEU points and 2.2 PARENT points, indicating L ATTICE is more generalizable to unseen tables.
We also observe that the improvement on BLEURT is not as much as the other two metrics.
It is reasonable as BLEURT is trained with machine translation annotations and synthetic data by mask filling, backtranslation and word drop.
These training data ensures its robustness to sur- [Table] [Table] face generation but not reasoning-based generation.
Although the effectiveness of BLEURT is verified on an RDF-to-text dataset, tabular data holds different properties with RDF data 7 .
Results on HiTab in Tab.
2 further verify the effectiveness and generalizability of L ATTICE .
For different model sizes, L ATTICE consistently performs better than T5 models.
We also observe that on this dataset the model with highest BLEU score is not the model with highest PARENT score.
It is partially because of the annotations.
Many numbers appear in both tables and target sentences are of different precision.
Copying such numbers from tables to generated sentences may increase
PARENT score but reduce BLEU score.
3. Robustness Evaluation
To further evaluate model robustness against content-invariant perturbations on tables, we create a harder version of the ToTTo dev set, where each table is perturbed with a combination of row-wise shuffling, column-wise shuffling and table transpose.
Especially, models can no longer benefit from memorizing the layout of tables appearing in both the training set and the dev set.
We compare four methods based on T5, including the basic version proposed by Kale and Rastogi (2020), enhanced T with the layout-agnostic input or data augmentation (§2.3), and T5 incorporated in L ATTICE .
According to the results shown in Tab. 3, vanilla T5 models face a severe performance drop when content-invariant perturbations are introduced.
Overall, BLEU scores drop by 3.4 for T5small, and 4.5 for T5-base.
We also observe that the performance drop on overlap subset is larger than on non-overlap subset.
This indicates that the performance gain of T5 models is somehow due to their memory of some tables existing in the training set, which is however brittle and not generalizable.
Applying layout-agnostic input format, which linearizes tables by lexicographic order instead of cell index order, ensures models to return stable predictions, but results in worse overall performance due to the loss of structural information.
Not surprisingly, layout-agnostic input causes performance drops by 1.5 BLEU points and 1.2 BLEU points to
T5-small and T5-base on original dev set.
Another common way to improve model robustness is to increase the diversity of training instances with data augmentation.
We augment the original training set by 8-fold using the three contentinvariant transformation operations and their combinations.
Training with augmented data reduces the gap between model performance on original tables and transformed tables.
However, data augmentation is never exhaustive enough to guarantee true equivariance.
Also, this introduces different variants of the same table into the training set, so there is a gap between the same table in training set and dev set.
As a result, the performance on overlap subset is slightly worse than without data augmentation, but the performance on non-overlap subset is not negatively influenced.
L ATTICE guarantees consistent predictions towards content-invariant table transformations while achieving the best performance.
In comparison with using layout-agnostic input format which also guarantees equivariance,
L ATTICE (T5-small) provides additional 3.3 BLEU points, and L ATTICE (T5-base) provides additional 2.4 BLEU points on original dev set. [Table] [Table]
3. Ablation Study
To help understand the effect of two key mechanisms in transformation-invariant graph masking, we hereby present ablation study results in Tab. 4.
Structure-Aware Self-Attention.
We examine the effectiveness of structure-aware self-attention.
In comparison with original (fully-connected) selfattention, incorporating structural information by pruning attention flows can improve the overall performance by 1.3 BLEU points.
Detailed scores on two subsets show that both tables seen and unseen during training can benefit from structural information.
The consistent improvements on two subsets indicate that structure-aware self-attention improves model ability of capturing cell relations rather than memorizing tables.
Transformation -Invariant Positional Encoding
We further test the effectiveness of transformationinvariant positional encoding.
We observe that although this technique is mainly designed for ensuring model robustness towards layout changes, it can bring an additional improvement of 0.5 BLEU points to overall performance.
Interestingly, the improvement is mainly on the overlap subset.
We attribute it to the fact that the same table in training and dev sets may have different highlighted cells, so that memorizing the layout information in the training set hinders in-domain generalization.
Related Work
We review two relevant research topics.
Since both topics have a large body of work, we provide a selected summary.
Table-to-text Generation.
Table-to-text generation seeks to generate textual descriptions for tabular data.
In comparison to text-to-text generation, the input of table-to-text generation is semistructured data.
Early studies adapt the encoderdecoder framework to data-to-text generation with encoders aggregating cell information (Lebret et al., 2016;
Wiseman et al., 2017; Bao et al., 2018).
Followed by the success of massively pre-trained sequence-to-sequence Transformer models (Raffel et al., 2020; Lewis et al., 2020), recent SOTA systems apply these models to table-to-text generation (Kale and Rastogi, 2020; Su et al., 2021), where the input table is linearized to a textual sequence.
A table can include ample information and it is not always able to be summarized in one sentence.
A line of work learns to generate selective descriptions by paying attention to key information in the table (Perez-Beltrachini and Lapata, 2018;
Ma et al., 2019).
However, multiple statements can be entailed from a table when different parts of the table are focused on.
To bridge this gap, Parikh et al.
(2020) proposes controlled table-to-text generation, allowing the generation process to react differently according to distinct highlighted cells.
As highlighted cells can be at any positions and of arbitrary numbers, simple linearization, which breaks the layout structure, hinders relations among cells from being captured, therefore causing unreliable or hallucinated descriptions to be generated.
A few prior studies introduce structural information to improve model performance on tableto-text generation, either by incorporating token position (Liu et al., 2018), or by aggregating row and column level information (Bao et al., 2018;
Nema et al., 2018; Jain et al., 2018).
However, none of existing methods can be directly applied to pretrained Transformer-based generative models, especially when we want to ensure model robustness to content-invariant table transformations.
Our method enforces both structure-awareness and transformation-invariance to such models.
Equivariant Representation Learning.
Equivariance is a type of prior knowledge existing broadly in real-world tasks.
Earlier studies show that incorporating equivariance learning can improve visual perception model robustness against turbulence caused by geometric transformations, such as realizing translation, rotation, and scale equivariance of images (Lenc and Vedaldi, 2015; Worrall et al., 2017;
Ravanbakhsh et al., 2017; Sosnovik et al., 2019; Yang et al., 2020).
The input to those tasks presents unstructured information, and several geometrically invariable operations are incorporated in neural networks to realize the aforementioned equivariance properties.
For example, Convolutional Neural Networks (CNNs) are equivariant to translations in nature (Lenc and
Vedaldi, 2015).
Harmonic Networks and Spherical
CNNs extend the equivariance of CNNs to rotations (Worrall et al., 2017; Esteves et al., 2018).
Group Equivariant Convolutional Networks are equivariant to more spatial transformations including translations, rotations and reflections (Cohen and Welling, 2016).
Nonetheless, none of these geometrically invariable techniques can be directly applied to Transformer-based generative models to ensure equivariance on (a part of) structured tabular data, which is exactly the focus of this work.
Our method realizes equivariant intermediate representations against content-invariant table transformations in table-to-text generation.
Some other works, while not explicitly using equivariant model structures, seek to realize equivariant representations by augmenting more diverse changes into training data (Chen et al., 2020a;
Wu et al., 2020).
Although the model can benefit from seeing more diverse inputs involving contentinvariant transformations (Wu et al., 2020), this strategy has two drawbacks.
Specifically, the augmented data, while introducing much computational overhead to training, are never exhaustive enough to guarantee true equivariance.
By contrast, our method guarantees equivariance through the neural network design and do not introduce any training overhead.
Conclusion
We propose L ATTICE , a structure-aware equivariance learning framework for controlled tableto-text generation.
Our experimental results verify the importance of structure-awareness and transformation-invariance, two key properties enforced in L ATTICE , towards precise and robust description generation for tabular content.
The proposed properties and equivariance learning framework aligns well with the nature of information organized in tables.
Future research can consider extending the structure-aware equivariance learning framework to other data-to-text generation tasks (Koncel-Kedziorski et al., 2019; Nan et al., 2021), tabular reasoning or retrieval tasks (Gupta et al., 2020;
Wang et al., 2021a,b; Eisenschlos et al., 2021), and pretraining representation on textual and tabular data (Yin et al., 2020; Herzig et al., 2020; Iida et al., 2021).
Acknowledgement
We appreciate the reviewers for their insightful comments and suggestions.
This work is partly supported by the National Science Foundation of
United States Grant IIS 2105329, and partly by the
Air Force Research Laboratory under agreement number FA8750-20-2-10002.
Ethical Considerations
This work seeks to develop a structure-aware equivariance learning framework for table-to-text generation.
Since the proposed method focuses on improving prior generation systems by better utilization of structural information, it does not introduce bias towards specific content.
The distinction between beneficial use and harmful use depends mainly on the data.
Proper use of the technology requires that input corpora are legally and ethically obtained.
We conduct experiments on two open benchmark in the way they intended to.
Although we create a harder version of ToTTo dev set, the table transformation operations we use are content-invariant, whereas the ground-truth generation remains the same as it is in the original dataset, ensuring no further social bias is introduced.