metadata

license: apache-2.0
base_model: Lowin/chinese-bigbird-wwm-base-4096
tags:
  - generated_from_trainer
  - finance
metrics:
  - accuracy
model-index:
  - name: >-
      chinese-bigbird-wwm-base-4096-wallstreetcn-morning-news-market-overview-open-000001SH-v1
    results: []
language:
  - zh
widget:
  - text: >-
      惠誉下调美国3A主权信用评级次日，经济学家看轻评级下调影响，美国7月ADP新增就业超预期爆表。风险情绪被重创，标普、道指、小盘股齐跌约1%，纳指跌超2%创2月以来最差。
      美国超导跌近29%。美债发行海啸即将来袭，10年期美债收益率一度创九个月新高，两年期美债收益率跌幅显著收窄。美元转涨刷新三周半高位。
      商品普跌。油价跌超2%，美油跌穿80美元整数位。黄金失守1940美元至三周新低。
      中国市场方面，美股时段，中概股指跌4%，理想汽车则再创历史新高，离岸人民币一度跌穿7.21元，最深跌270点至一周低位。沪指收跌近1%，医药、银行疲软，超导概念、地产、券商强势。恒指收跌2.47%，南向资金净流入4.02亿港元。

chinese-bigbird-wwm-base-4096-wallstreetcn-morning-news-market-overview-open-000001SH-v1

This model is a fine-tuned version of Lowin/chinese-bigbird-wwm-base-4096 on the dataset of Wallstreetcn Morning News Market Overview with overnight index (000001.SH) movement labels. It achieves the following results on the evaluation set:

Loss: 0.955115795135498
Accuracy: 0.6896551724137931

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
No log	1.0	75	0.6903	0.5862
No log	2.0	150	0.6608	0.6552
No log	3.0	225	0.9551	0.6897
No log	4.0	300	1.8075	0.5862
No log	5.0	375	1.7461	0.6552
No log	6.0	450	2.2845	0.5862
0.3813	7.0	525	2.2898	0.5862
0.3813	8.0	600	2.0169	0.6552
0.3813	9.0	675	2.2466	0.6552
0.3813	10.0	750	2.2800	0.6552

Framework versions

Transformers 4.31.0
Pytorch 2.0.1+cu118
Datasets 2.14.2
Tokenizers 0.13.3