dat
commited on
Commit
•
863f702
1
Parent(s):
c48cf13
update readme
Browse files- README.md +7 -1
- events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2 +2 -2
- wandb/run-20210716_223350-8eukt20m/files/output.log +320 -0
- wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json +1 -1
- wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log +644 -0
- wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb +0 -0
README.md
CHANGED
|
@@ -7,7 +7,13 @@ datasets:
|
|
| 7 |
|
| 8 |
# Pino (BigBird) base model
|
| 9 |
|
| 10 |
-
Created by Dat Nguyen & Yeb Havinga
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
| 13 |
|
|
|
|
| 7 |
|
| 8 |
# Pino (BigBird) base model
|
| 9 |
|
| 10 |
+
Created by [Dat Nguyen](https://www.linkedin.com/in/dat-nguyen-49a641138/) & Yeb Havinga during the [Hugging Face community week](https://discuss.huggingface.co/t/open-to-the-community-community-week-using-jax-flax-for-nlp-cv/7104)
|
| 11 |
+
|
| 12 |
+
|
| 13 |
+
|
| 14 |
+
Please do not hesitate to contact me via [LinkedIn](https://www.linkedin.com/in/henryk-borzymowski-0755a2167/=
|
| 15 |
+
|
| 16 |
+
|
| 17 |
|
| 18 |
BigBird, is a sparse-attention based transformer which extends Transformer based models, such as BERT to much longer sequences. Moreover, BigBird comes along with a theoretical understanding of the capabilities of a complete transformer that the sparse model can handle.
|
| 19 |
|
events.out.tfevents.1626474829.t1v-n-f5c06ea1-w-0.798495.3.v2
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2eba091f8fe3f0ead59825c7368f8ceef1e86032529a74117afab28db1b6b4d1
|
| 3 |
+
size 2128342
|
wandb/run-20210716_223350-8eukt20m/files/output.log
CHANGED
|
@@ -1831,3 +1831,323 @@ Training...: 11749it [1:24:42, 5.33it/s]█████████████
|
|
| 1831 |
|
| 1832 |
|
| 1833 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1831 |
|
| 1832 |
|
| 1833 |
|
| 1834 |
+
Training...: 11799it [1:24:58, 5.03it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1835 |
+
|
| 1836 |
+
|
| 1837 |
+
|
| 1838 |
+
|
| 1839 |
+
|
| 1840 |
+
|
| 1841 |
+
Training...: 11849it [1:25:18, 5.39it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1842 |
+
|
| 1843 |
+
|
| 1844 |
+
|
| 1845 |
+
|
| 1846 |
+
|
| 1847 |
+
|
| 1848 |
+
Training...: 11899it [1:25:38, 3.71it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1849 |
+
|
| 1850 |
+
|
| 1851 |
+
|
| 1852 |
+
|
| 1853 |
+
|
| 1854 |
+
|
| 1855 |
+
Training...: 11949it [1:25:58, 5.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1856 |
+
|
| 1857 |
+
|
| 1858 |
+
|
| 1859 |
+
|
| 1860 |
+
|
| 1861 |
+
Training...: 11999it [1:26:18, 5.52it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1862 |
+
|
| 1863 |
+
|
| 1864 |
+
|
| 1865 |
+
|
| 1866 |
+
|
| 1867 |
+
|
| 1868 |
+
Training...: 12049it [1:26:38, 5.20it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1869 |
+
|
| 1870 |
+
|
| 1871 |
+
|
| 1872 |
+
|
| 1873 |
+
|
| 1874 |
+
Training...: 12099it [1:26:58, 6.00it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1875 |
+
|
| 1876 |
+
|
| 1877 |
+
|
| 1878 |
+
|
| 1879 |
+
|
| 1880 |
+
Training...: 12149it [1:27:18, 4.68it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1881 |
+
|
| 1882 |
+
|
| 1883 |
+
|
| 1884 |
+
|
| 1885 |
+
|
| 1886 |
+
|
| 1887 |
+
Training...: 12199it [1:27:39, 5.79it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1888 |
+
|
| 1889 |
+
|
| 1890 |
+
|
| 1891 |
+
|
| 1892 |
+
|
| 1893 |
+
Training...: 12249it [1:27:58, 6.06it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1894 |
+
|
| 1895 |
+
|
| 1896 |
+
|
| 1897 |
+
|
| 1898 |
+
|
| 1899 |
+
|
| 1900 |
+
|
| 1901 |
+
Training...: 12301it [1:28:30, 2.19s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1902 |
+
|
| 1903 |
+
|
| 1904 |
+
|
| 1905 |
+
|
| 1906 |
+
|
| 1907 |
+
|
| 1908 |
+
Training...: 12350it [1:28:50, 3.36s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1909 |
+
|
| 1910 |
+
|
| 1911 |
+
|
| 1912 |
+
|
| 1913 |
+
|
| 1914 |
+
Training...: 12399it [1:28:59, 6.19it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1915 |
+
|
| 1916 |
+
|
| 1917 |
+
|
| 1918 |
+
|
| 1919 |
+
|
| 1920 |
+
|
| 1921 |
+
Training...: 12450it [1:29:30, 3.28s/it]███████████��█████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1922 |
+
|
| 1923 |
+
|
| 1924 |
+
|
| 1925 |
+
|
| 1926 |
+
|
| 1927 |
+
|
| 1928 |
+
Training...: 12500it [1:29:50, 3.33s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1929 |
+
|
| 1930 |
+
|
| 1931 |
+
|
| 1932 |
+
|
| 1933 |
+
|
| 1934 |
+
|
| 1935 |
+
Training...: 12551it [1:30:11, 2.43s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1936 |
+
|
| 1937 |
+
|
| 1938 |
+
|
| 1939 |
+
|
| 1940 |
+
|
| 1941 |
+
|
| 1942 |
+
Training...: 12601it [1:30:31, 2.51s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1943 |
+
|
| 1944 |
+
|
| 1945 |
+
|
| 1946 |
+
|
| 1947 |
+
|
| 1948 |
+
|
| 1949 |
+
Training...: 12652it [1:30:51, 1.72s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1950 |
+
|
| 1951 |
+
|
| 1952 |
+
|
| 1953 |
+
|
| 1954 |
+
|
| 1955 |
+
|
| 1956 |
+
Training...: 12701it [1:31:11, 2.31s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1957 |
+
|
| 1958 |
+
|
| 1959 |
+
|
| 1960 |
+
|
| 1961 |
+
|
| 1962 |
+
Training...: 12749it [1:31:20, 5.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1963 |
+
|
| 1964 |
+
|
| 1965 |
+
|
| 1966 |
+
|
| 1967 |
+
|
| 1968 |
+
|
| 1969 |
+
Training...: 12799it [1:31:41, 5.74it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1970 |
+
|
| 1971 |
+
|
| 1972 |
+
|
| 1973 |
+
|
| 1974 |
+
|
| 1975 |
+
|
| 1976 |
+
Training...: 12849it [1:32:01, 4.90it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1977 |
+
|
| 1978 |
+
|
| 1979 |
+
|
| 1980 |
+
|
| 1981 |
+
|
| 1982 |
+
|
| 1983 |
+
Training...: 12899it [1:32:21, 6.00it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1984 |
+
|
| 1985 |
+
|
| 1986 |
+
|
| 1987 |
+
|
| 1988 |
+
|
| 1989 |
+
|
| 1990 |
+
Training...: 12949it [1:32:41, 4.88it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1991 |
+
|
| 1992 |
+
|
| 1993 |
+
|
| 1994 |
+
|
| 1995 |
+
|
| 1996 |
+
|
| 1997 |
+
Training...: 12999it [1:33:02, 4.03it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 1998 |
+
|
| 1999 |
+
|
| 2000 |
+
|
| 2001 |
+
|
| 2002 |
+
|
| 2003 |
+
|
| 2004 |
+
Training...: 13049it [1:33:22, 5.20it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2005 |
+
|
| 2006 |
+
|
| 2007 |
+
|
| 2008 |
+
|
| 2009 |
+
|
| 2010 |
+
|
| 2011 |
+
|
| 2012 |
+
Training...: 13107it [1:33:54, 2.24it/s]███████████████████████████████████████████████████████████████████████��█████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2013 |
+
|
| 2014 |
+
|
| 2015 |
+
|
| 2016 |
+
|
| 2017 |
+
Training...: 13149it [1:34:02, 4.53it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2018 |
+
|
| 2019 |
+
|
| 2020 |
+
|
| 2021 |
+
|
| 2022 |
+
|
| 2023 |
+
|
| 2024 |
+
|
| 2025 |
+
Training...: 13209it [1:34:34, 3.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2026 |
+
|
| 2027 |
+
|
| 2028 |
+
|
| 2029 |
+
|
| 2030 |
+
|
| 2031 |
+
|
| 2032 |
+
Training...: 13257it [1:34:54, 2.29it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2033 |
+
|
| 2034 |
+
|
| 2035 |
+
|
| 2036 |
+
|
| 2037 |
+
|
| 2038 |
+
Training...: 13309it [1:35:15, 3.18it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2039 |
+
|
| 2040 |
+
|
| 2041 |
+
|
| 2042 |
+
|
| 2043 |
+
|
| 2044 |
+
|
| 2045 |
+
Training...: 13357it [1:35:35, 2.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2046 |
+
|
| 2047 |
+
|
| 2048 |
+
|
| 2049 |
+
|
| 2050 |
+
|
| 2051 |
+
Training...: 13400it [1:35:53, 3.30s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2052 |
+
|
| 2053 |
+
|
| 2054 |
+
|
| 2055 |
+
|
| 2056 |
+
|
| 2057 |
+
Training...: 13449it [1:36:02, 6.12it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2058 |
+
|
| 2059 |
+
|
| 2060 |
+
|
| 2061 |
+
|
| 2062 |
+
|
| 2063 |
+
|
| 2064 |
+
Training...: 13500it [1:36:34, 3.23s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2065 |
+
|
| 2066 |
+
|
| 2067 |
+
|
| 2068 |
+
|
| 2069 |
+
|
| 2070 |
+
|
| 2071 |
+
Training...: 13551it [1:36:54, 2.35s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2072 |
+
|
| 2073 |
+
|
| 2074 |
+
|
| 2075 |
+
|
| 2076 |
+
|
| 2077 |
+
|
| 2078 |
+
Training...: 13602it [1:37:15, 1.83s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2079 |
+
|
| 2080 |
+
|
| 2081 |
+
|
| 2082 |
+
|
| 2083 |
+
|
| 2084 |
+
|
| 2085 |
+
Training...: 13651it [1:37:35, 2.23s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2086 |
+
|
| 2087 |
+
|
| 2088 |
+
|
| 2089 |
+
|
| 2090 |
+
|
| 2091 |
+
|
| 2092 |
+
Training...: 13702it [1:37:55, 1.76s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2093 |
+
|
| 2094 |
+
|
| 2095 |
+
|
| 2096 |
+
|
| 2097 |
+
|
| 2098 |
+
|
| 2099 |
+
Training...: 13752it [1:38:15, 1.79s/it]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2100 |
+
|
| 2101 |
+
|
| 2102 |
+
|
| 2103 |
+
|
| 2104 |
+
|
| 2105 |
+
|
| 2106 |
+
Training...: 13804it [1:38:36, 1.06it/s]███████��█████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2107 |
+
|
| 2108 |
+
|
| 2109 |
+
|
| 2110 |
+
|
| 2111 |
+
|
| 2112 |
+
|
| 2113 |
+
Training...: 13854it [1:38:56, 1.04it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2114 |
+
|
| 2115 |
+
|
| 2116 |
+
|
| 2117 |
+
|
| 2118 |
+
|
| 2119 |
+
Training...: 13907it [1:39:16, 2.21it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2120 |
+
|
| 2121 |
+
|
| 2122 |
+
|
| 2123 |
+
|
| 2124 |
+
|
| 2125 |
+
Training...: 13954it [1:39:36, 1.05it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2126 |
+
|
| 2127 |
+
|
| 2128 |
+
|
| 2129 |
+
|
| 2130 |
+
Training...: 13999it [1:39:45, 5.27it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2131 |
+
|
| 2132 |
+
|
| 2133 |
+
|
| 2134 |
+
|
| 2135 |
+
|
| 2136 |
+
|
| 2137 |
+
Training...: 14056it [1:40:17, 1.69it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2138 |
+
|
| 2139 |
+
|
| 2140 |
+
|
| 2141 |
+
|
| 2142 |
+
|
| 2143 |
+
Training...: 14099it [1:40:25, 6.17it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2144 |
+
|
| 2145 |
+
|
| 2146 |
+
|
| 2147 |
+
|
| 2148 |
+
|
| 2149 |
+
Training...: 14149it [1:40:45, 5.64it/s]█████████████████████████████████████████████████████████████████████████████████████████████████| 500/500 [01:17<00:00, 7.90it/s]
|
| 2150 |
+
|
| 2151 |
+
|
| 2152 |
+
|
| 2153 |
+
|
wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"training_step":
|
|
|
|
| 1 |
+
{"training_step": 344150, "learning_rate": 2.2845080820843577e-05, "train_loss": 1.9759552478790283, "_runtime": 6408, "_timestamp": 1626481238, "_step": 283, "eval_step": 340000, "eval_accuracy": 0.6408576965332031, "eval_loss": 1.8213207721710205}
|
wandb/run-20210716_223350-8eukt20m/logs/debug-internal.log
CHANGED
|
@@ -3607,3 +3607,647 @@
|
|
| 3607 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3608 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3609 |
2021-07-17 00:04:50,671 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3607 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3608 |
2021-07-17 00:04:50,671 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3609 |
2021-07-17 00:04:50,671 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3610 |
+
2021-07-17 00:04:51,359 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3611 |
+
2021-07-17 00:04:52,360 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3612 |
+
2021-07-17 00:04:54,360 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3613 |
+
2021-07-17 00:04:56,361 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3614 |
+
2021-07-17 00:04:59,363 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3615 |
+
2021-07-17 00:05:00,492 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3616 |
+
2021-07-17 00:05:00,493 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3617 |
+
2021-07-17 00:05:01,363 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3618 |
+
2021-07-17 00:05:03,364 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3619 |
+
2021-07-17 00:05:04,260 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3620 |
+
2021-07-17 00:05:10,826 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3621 |
+
2021-07-17 00:05:10,826 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3622 |
+
2021-07-17 00:05:10,827 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3623 |
+
2021-07-17 00:05:11,368 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3624 |
+
2021-07-17 00:05:12,368 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3625 |
+
2021-07-17 00:05:13,369 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3626 |
+
2021-07-17 00:05:15,370 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3627 |
+
2021-07-17 00:05:15,685 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3628 |
+
2021-07-17 00:05:15,686 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3629 |
+
2021-07-17 00:05:17,371 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3630 |
+
2021-07-17 00:05:19,372 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3631 |
+
2021-07-17 00:05:21,373 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3632 |
+
2021-07-17 00:05:23,374 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3633 |
+
2021-07-17 00:05:30,844 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3634 |
+
2021-07-17 00:05:30,844 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3635 |
+
2021-07-17 00:05:30,974 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3636 |
+
2021-07-17 00:05:30,974 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3637 |
+
2021-07-17 00:05:30,975 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3638 |
+
2021-07-17 00:05:31,377 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3639 |
+
2021-07-17 00:05:33,378 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3640 |
+
2021-07-17 00:05:34,335 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3641 |
+
2021-07-17 00:05:35,379 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3642 |
+
2021-07-17 00:05:37,380 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3643 |
+
2021-07-17 00:05:39,381 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3644 |
+
2021-07-17 00:05:41,382 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3645 |
+
2021-07-17 00:05:43,383 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3646 |
+
2021-07-17 00:05:46,022 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3647 |
+
2021-07-17 00:05:46,022 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3648 |
+
2021-07-17 00:05:51,122 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3649 |
+
2021-07-17 00:05:51,122 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3650 |
+
2021-07-17 00:05:51,123 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3651 |
+
2021-07-17 00:05:51,386 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3652 |
+
2021-07-17 00:05:53,387 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3653 |
+
2021-07-17 00:05:55,388 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3654 |
+
2021-07-17 00:05:57,389 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3655 |
+
2021-07-17 00:05:59,390 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3656 |
+
2021-07-17 00:06:01,232 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3657 |
+
2021-07-17 00:06:01,232 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3658 |
+
2021-07-17 00:06:01,391 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3659 |
+
2021-07-17 00:06:04,409 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3660 |
+
2021-07-17 00:06:11,364 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3661 |
+
2021-07-17 00:06:11,364 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3662 |
+
2021-07-17 00:06:11,364 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3663 |
+
2021-07-17 00:06:11,395 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3664 |
+
2021-07-17 00:06:13,396 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3665 |
+
2021-07-17 00:06:15,397 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3666 |
+
2021-07-17 00:06:16,443 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3667 |
+
2021-07-17 00:06:16,443 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3668 |
+
2021-07-17 00:06:18,398 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3669 |
+
2021-07-17 00:06:20,399 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3670 |
+
2021-07-17 00:06:22,400 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3671 |
+
2021-07-17 00:06:24,401 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3672 |
+
2021-07-17 00:06:31,511 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3673 |
+
2021-07-17 00:06:31,512 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3674 |
+
2021-07-17 00:06:31,512 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3675 |
+
2021-07-17 00:06:31,682 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3676 |
+
2021-07-17 00:06:31,683 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3677 |
+
2021-07-17 00:06:32,405 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3678 |
+
2021-07-17 00:06:33,405 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3679 |
+
2021-07-17 00:06:34,406 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3680 |
+
2021-07-17 00:06:34,482 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3681 |
+
2021-07-17 00:06:36,406 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3682 |
+
2021-07-17 00:06:38,407 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3683 |
+
2021-07-17 00:06:40,408 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3684 |
+
2021-07-17 00:06:42,409 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3685 |
+
2021-07-17 00:06:46,879 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3686 |
+
2021-07-17 00:06:46,879 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3687 |
+
2021-07-17 00:06:51,687 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3688 |
+
2021-07-17 00:06:51,687 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3689 |
+
2021-07-17 00:06:51,688 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3690 |
+
2021-07-17 00:06:52,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3691 |
+
2021-07-17 00:06:53,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3692 |
+
2021-07-17 00:06:54,414 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3693 |
+
2021-07-17 00:06:56,415 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3694 |
+
2021-07-17 00:06:58,416 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3695 |
+
2021-07-17 00:07:00,417 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3696 |
+
2021-07-17 00:07:02,010 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3697 |
+
2021-07-17 00:07:02,011 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3698 |
+
2021-07-17 00:07:02,418 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3699 |
+
2021-07-17 00:07:04,558 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3700 |
+
2021-07-17 00:07:11,868 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3701 |
+
2021-07-17 00:07:11,868 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3702 |
+
2021-07-17 00:07:11,869 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3703 |
+
2021-07-17 00:07:12,422 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3704 |
+
2021-07-17 00:07:13,422 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3705 |
+
2021-07-17 00:07:14,423 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3706 |
+
2021-07-17 00:07:16,423 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3707 |
+
2021-07-17 00:07:17,189 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3708 |
+
2021-07-17 00:07:17,189 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3709 |
+
2021-07-17 00:07:18,424 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3710 |
+
2021-07-17 00:07:20,425 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3711 |
+
2021-07-17 00:07:22,426 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3712 |
+
2021-07-17 00:07:24,427 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3713 |
+
2021-07-17 00:07:32,074 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3714 |
+
2021-07-17 00:07:32,074 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3715 |
+
2021-07-17 00:07:32,075 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3716 |
+
2021-07-17 00:07:32,393 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3717 |
+
2021-07-17 00:07:32,393 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3718 |
+
2021-07-17 00:07:32,430 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3719 |
+
2021-07-17 00:07:33,430 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3720 |
+
2021-07-17 00:07:34,431 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3721 |
+
2021-07-17 00:07:34,632 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3722 |
+
2021-07-17 00:07:36,432 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3723 |
+
2021-07-17 00:07:39,433 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3724 |
+
2021-07-17 00:07:41,434 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3725 |
+
2021-07-17 00:07:43,435 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3726 |
+
2021-07-17 00:07:47,527 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3727 |
+
2021-07-17 00:07:47,528 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3728 |
+
2021-07-17 00:07:52,282 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3729 |
+
2021-07-17 00:07:52,282 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3730 |
+
2021-07-17 00:07:52,283 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3731 |
+
2021-07-17 00:07:52,438 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3732 |
+
2021-07-17 00:07:53,439 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3733 |
+
2021-07-17 00:07:55,440 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3734 |
+
2021-07-17 00:07:57,440 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3735 |
+
2021-07-17 00:07:59,441 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3736 |
+
2021-07-17 00:08:01,442 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3737 |
+
2021-07-17 00:08:02,702 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3738 |
+
2021-07-17 00:08:02,703 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3739 |
+
2021-07-17 00:08:03,443 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3740 |
+
2021-07-17 00:08:04,703 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3741 |
+
2021-07-17 00:08:05,444 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3742 |
+
2021-07-17 00:08:12,419 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3743 |
+
2021-07-17 00:08:12,419 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3744 |
+
2021-07-17 00:08:12,420 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3745 |
+
2021-07-17 00:08:12,447 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3746 |
+
2021-07-17 00:08:13,447 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3747 |
+
2021-07-17 00:08:14,448 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3748 |
+
2021-07-17 00:08:15,448 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3749 |
+
2021-07-17 00:08:17,449 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3750 |
+
2021-07-17 00:08:17,900 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3751 |
+
2021-07-17 00:08:17,900 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3752 |
+
2021-07-17 00:08:19,450 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3753 |
+
2021-07-17 00:08:21,451 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3754 |
+
2021-07-17 00:08:23,452 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3755 |
+
2021-07-17 00:08:32,629 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3756 |
+
2021-07-17 00:08:32,629 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3757 |
+
2021-07-17 00:08:32,630 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3758 |
+
2021-07-17 00:08:33,095 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3759 |
+
2021-07-17 00:08:33,096 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3760 |
+
2021-07-17 00:08:33,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3761 |
+
2021-07-17 00:08:33,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3762 |
+
2021-07-17 00:08:34,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3763 |
+
2021-07-17 00:08:34,778 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3764 |
+
2021-07-17 00:08:35,456 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3765 |
+
2021-07-17 00:08:37,457 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3766 |
+
2021-07-17 00:08:39,458 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3767 |
+
2021-07-17 00:08:41,459 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3768 |
+
2021-07-17 00:08:43,460 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3769 |
+
2021-07-17 00:08:48,292 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3770 |
+
2021-07-17 00:08:48,292 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3771 |
+
2021-07-17 00:08:52,817 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3772 |
+
2021-07-17 00:08:52,817 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3773 |
+
2021-07-17 00:08:52,818 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3774 |
+
2021-07-17 00:08:53,464 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3775 |
+
2021-07-17 00:08:54,465 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3776 |
+
2021-07-17 00:08:55,465 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3777 |
+
2021-07-17 00:08:57,466 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3778 |
+
2021-07-17 00:08:59,467 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3779 |
+
2021-07-17 00:09:01,468 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3780 |
+
2021-07-17 00:09:03,424 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3781 |
+
2021-07-17 00:09:03,424 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3782 |
+
2021-07-17 00:09:03,469 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3783 |
+
2021-07-17 00:09:04,852 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3784 |
+
2021-07-17 00:09:13,130 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3785 |
+
2021-07-17 00:09:13,130 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3786 |
+
2021-07-17 00:09:13,131 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3787 |
+
2021-07-17 00:09:13,473 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3788 |
+
2021-07-17 00:09:13,473 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3789 |
+
2021-07-17 00:09:14,474 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3790 |
+
2021-07-17 00:09:16,474 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3791 |
+
2021-07-17 00:09:18,475 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3792 |
+
2021-07-17 00:09:18,573 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3793 |
+
2021-07-17 00:09:18,574 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3794 |
+
2021-07-17 00:09:20,476 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3795 |
+
2021-07-17 00:09:22,477 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3796 |
+
2021-07-17 00:09:24,478 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3797 |
+
2021-07-17 00:09:33,265 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3798 |
+
2021-07-17 00:09:33,265 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3799 |
+
2021-07-17 00:09:33,266 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3800 |
+
2021-07-17 00:09:33,482 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3801 |
+
2021-07-17 00:09:33,871 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3802 |
+
2021-07-17 00:09:33,872 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3803 |
+
2021-07-17 00:09:34,483 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3804 |
+
2021-07-17 00:09:34,922 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3805 |
+
2021-07-17 00:09:36,483 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3806 |
+
2021-07-17 00:09:38,484 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3807 |
+
2021-07-17 00:09:40,485 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3808 |
+
2021-07-17 00:09:42,486 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3809 |
+
2021-07-17 00:09:44,487 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3810 |
+
2021-07-17 00:09:49,131 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3811 |
+
2021-07-17 00:09:49,131 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3812 |
+
2021-07-17 00:09:53,471 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3813 |
+
2021-07-17 00:09:53,471 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3814 |
+
2021-07-17 00:09:53,472 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3815 |
+
2021-07-17 00:09:53,491 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3816 |
+
2021-07-17 00:09:54,492 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3817 |
+
2021-07-17 00:09:56,493 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3818 |
+
2021-07-17 00:09:58,494 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3819 |
+
2021-07-17 00:10:00,495 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3820 |
+
2021-07-17 00:10:02,496 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3821 |
+
2021-07-17 00:10:04,263 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3822 |
+
2021-07-17 00:10:04,263 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3823 |
+
2021-07-17 00:10:04,496 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3824 |
+
2021-07-17 00:10:04,991 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3825 |
+
2021-07-17 00:10:13,602 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3826 |
+
2021-07-17 00:10:13,603 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3827 |
+
2021-07-17 00:10:13,603 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3828 |
+
2021-07-17 00:10:14,500 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3829 |
+
2021-07-17 00:10:14,501 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3830 |
+
2021-07-17 00:10:16,501 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3831 |
+
2021-07-17 00:10:18,502 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3832 |
+
2021-07-17 00:10:19,407 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3833 |
+
2021-07-17 00:10:19,407 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3834 |
+
2021-07-17 00:10:20,503 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3835 |
+
2021-07-17 00:10:22,504 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3836 |
+
2021-07-17 00:10:24,505 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3837 |
+
2021-07-17 00:10:33,818 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3838 |
+
2021-07-17 00:10:33,818 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3839 |
+
2021-07-17 00:10:33,819 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3840 |
+
2021-07-17 00:10:34,508 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3841 |
+
2021-07-17 00:10:34,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3842 |
+
2021-07-17 00:10:34,643 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3843 |
+
2021-07-17 00:10:34,643 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3844 |
+
2021-07-17 00:10:35,059 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3845 |
+
2021-07-17 00:10:35,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3846 |
+
2021-07-17 00:10:36,509 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3847 |
+
2021-07-17 00:10:38,510 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3848 |
+
2021-07-17 00:10:40,511 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3849 |
+
2021-07-17 00:10:42,512 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3850 |
+
2021-07-17 00:10:45,513 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3851 |
+
2021-07-17 00:10:49,842 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3852 |
+
2021-07-17 00:10:49,842 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3853 |
+
2021-07-17 00:10:54,000 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3854 |
+
2021-07-17 00:10:54,000 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3855 |
+
2021-07-17 00:10:54,001 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3856 |
+
2021-07-17 00:10:54,517 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3857 |
+
2021-07-17 00:10:55,518 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3858 |
+
2021-07-17 00:10:57,519 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3859 |
+
2021-07-17 00:10:59,520 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3860 |
+
2021-07-17 00:11:01,521 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3861 |
+
2021-07-17 00:11:03,522 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3862 |
+
2021-07-17 00:11:04,971 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3863 |
+
2021-07-17 00:11:04,972 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3864 |
+
2021-07-17 00:11:05,126 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3865 |
+
2021-07-17 00:11:05,523 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3866 |
+
2021-07-17 00:11:14,147 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3867 |
+
2021-07-17 00:11:14,148 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3868 |
+
2021-07-17 00:11:14,148 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3869 |
+
2021-07-17 00:11:14,526 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3870 |
+
2021-07-17 00:11:15,527 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3871 |
+
2021-07-17 00:11:17,528 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3872 |
+
2021-07-17 00:11:19,529 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3873 |
+
2021-07-17 00:11:20,106 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3874 |
+
2021-07-17 00:11:20,107 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3875 |
+
2021-07-17 00:11:21,530 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3876 |
+
2021-07-17 00:11:23,531 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3877 |
+
2021-07-17 00:11:25,532 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3878 |
+
2021-07-17 00:11:34,235 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3879 |
+
2021-07-17 00:11:34,235 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3880 |
+
2021-07-17 00:11:34,236 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3881 |
+
2021-07-17 00:11:34,536 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3882 |
+
2021-07-17 00:11:35,195 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3883 |
+
2021-07-17 00:11:35,261 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3884 |
+
2021-07-17 00:11:35,262 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3885 |
+
2021-07-17 00:11:35,536 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3886 |
+
2021-07-17 00:11:37,537 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3887 |
+
2021-07-17 00:11:39,538 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3888 |
+
2021-07-17 00:11:41,539 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3889 |
+
2021-07-17 00:11:43,539 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3890 |
+
2021-07-17 00:11:45,540 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3891 |
+
2021-07-17 00:11:50,473 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3892 |
+
2021-07-17 00:11:50,474 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3893 |
+
2021-07-17 00:11:54,378 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3894 |
+
2021-07-17 00:11:54,379 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3895 |
+
2021-07-17 00:11:54,379 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3896 |
+
2021-07-17 00:11:54,544 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3897 |
+
2021-07-17 00:11:55,544 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3898 |
+
2021-07-17 00:11:58,545 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3899 |
+
2021-07-17 00:12:00,546 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3900 |
+
2021-07-17 00:12:02,547 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3901 |
+
2021-07-17 00:12:04,548 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3902 |
+
2021-07-17 00:12:05,268 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3903 |
+
2021-07-17 00:12:05,606 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3904 |
+
2021-07-17 00:12:05,607 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3905 |
+
2021-07-17 00:12:06,549 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3906 |
+
2021-07-17 00:12:14,534 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3907 |
+
2021-07-17 00:12:14,535 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3908 |
+
2021-07-17 00:12:14,535 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3909 |
+
2021-07-17 00:12:14,551 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3910 |
+
2021-07-17 00:12:15,552 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3911 |
+
2021-07-17 00:12:16,552 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3912 |
+
2021-07-17 00:12:18,553 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3913 |
+
2021-07-17 00:12:20,554 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3914 |
+
2021-07-17 00:12:20,792 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3915 |
+
2021-07-17 00:12:20,792 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3916 |
+
2021-07-17 00:12:22,555 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3917 |
+
2021-07-17 00:12:24,556 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3918 |
+
2021-07-17 00:12:26,556 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3919 |
+
2021-07-17 00:12:34,781 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3920 |
+
2021-07-17 00:12:34,782 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3921 |
+
2021-07-17 00:12:34,782 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3922 |
+
2021-07-17 00:12:35,339 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3923 |
+
2021-07-17 00:12:35,560 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3924 |
+
2021-07-17 00:12:35,560 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3925 |
+
2021-07-17 00:12:35,975 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3926 |
+
2021-07-17 00:12:35,976 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3927 |
+
2021-07-17 00:12:36,561 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3928 |
+
2021-07-17 00:12:38,562 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3929 |
+
2021-07-17 00:12:40,562 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3930 |
+
2021-07-17 00:12:42,563 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3931 |
+
2021-07-17 00:12:44,564 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3932 |
+
2021-07-17 00:12:46,565 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3933 |
+
2021-07-17 00:12:51,149 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3934 |
+
2021-07-17 00:12:51,149 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3935 |
+
2021-07-17 00:12:54,966 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3936 |
+
2021-07-17 00:12:54,967 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3937 |
+
2021-07-17 00:12:54,967 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3938 |
+
2021-07-17 00:12:55,568 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3939 |
+
2021-07-17 00:12:55,568 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3940 |
+
2021-07-17 00:12:56,569 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3941 |
+
2021-07-17 00:12:58,569 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3942 |
+
2021-07-17 00:13:00,570 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3943 |
+
2021-07-17 00:13:02,571 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3944 |
+
2021-07-17 00:13:04,572 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3945 |
+
2021-07-17 00:13:05,413 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3946 |
+
2021-07-17 00:13:06,280 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3947 |
+
2021-07-17 00:13:06,281 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3948 |
+
2021-07-17 00:13:07,573 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3949 |
+
2021-07-17 00:13:15,188 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3950 |
+
2021-07-17 00:13:15,188 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3951 |
+
2021-07-17 00:13:15,189 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3952 |
+
2021-07-17 00:13:15,576 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3953 |
+
2021-07-17 00:13:15,576 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3954 |
+
2021-07-17 00:13:17,577 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3955 |
+
2021-07-17 00:13:19,578 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3956 |
+
2021-07-17 00:13:21,481 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3957 |
+
2021-07-17 00:13:21,482 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3958 |
+
2021-07-17 00:13:21,579 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3959 |
+
2021-07-17 00:13:23,580 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3960 |
+
2021-07-17 00:13:25,581 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3961 |
+
2021-07-17 00:13:27,581 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3962 |
+
2021-07-17 00:13:35,343 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3963 |
+
2021-07-17 00:13:35,343 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3964 |
+
2021-07-17 00:13:35,344 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3965 |
+
2021-07-17 00:13:35,485 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3966 |
+
2021-07-17 00:13:35,585 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3967 |
+
2021-07-17 00:13:36,665 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3968 |
+
2021-07-17 00:13:36,665 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3969 |
+
2021-07-17 00:13:37,586 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3970 |
+
2021-07-17 00:13:38,586 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3971 |
+
2021-07-17 00:13:39,587 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3972 |
+
2021-07-17 00:13:41,587 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3973 |
+
2021-07-17 00:13:43,588 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3974 |
+
2021-07-17 00:13:45,589 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3975 |
+
2021-07-17 00:13:51,851 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3976 |
+
2021-07-17 00:13:51,851 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3977 |
+
2021-07-17 00:13:55,544 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3978 |
+
2021-07-17 00:13:55,544 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3979 |
+
2021-07-17 00:13:55,545 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3980 |
+
2021-07-17 00:13:55,593 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3981 |
+
2021-07-17 00:13:56,594 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3982 |
+
2021-07-17 00:13:57,594 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3983 |
+
2021-07-17 00:13:59,595 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3984 |
+
2021-07-17 00:14:01,596 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3985 |
+
2021-07-17 00:14:03,597 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3986 |
+
2021-07-17 00:14:05,557 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 3987 |
+
2021-07-17 00:14:05,597 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3988 |
+
2021-07-17 00:14:06,984 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3989 |
+
2021-07-17 00:14:06,985 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3990 |
+
2021-07-17 00:14:07,598 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3991 |
+
2021-07-17 00:14:15,828 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 3992 |
+
2021-07-17 00:14:15,829 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 3993 |
+
2021-07-17 00:14:15,829 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 3994 |
+
2021-07-17 00:14:16,601 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 3995 |
+
2021-07-17 00:14:18,602 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3996 |
+
2021-07-17 00:14:20,603 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 3997 |
+
2021-07-17 00:14:22,162 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 3998 |
+
2021-07-17 00:14:22,162 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 3999 |
+
2021-07-17 00:14:22,604 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4000 |
+
2021-07-17 00:14:24,605 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4001 |
+
2021-07-17 00:14:26,606 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4002 |
+
2021-07-17 00:14:28,607 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4003 |
+
2021-07-17 00:14:35,630 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4004 |
+
2021-07-17 00:14:36,002 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4005 |
+
2021-07-17 00:14:36,003 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4006 |
+
2021-07-17 00:14:36,004 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4007 |
+
2021-07-17 00:14:36,611 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4008 |
+
2021-07-17 00:14:37,382 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4009 |
+
2021-07-17 00:14:37,383 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4010 |
+
2021-07-17 00:14:38,612 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4011 |
+
2021-07-17 00:14:40,613 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4012 |
+
2021-07-17 00:14:42,614 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4013 |
+
2021-07-17 00:14:44,614 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4014 |
+
2021-07-17 00:14:46,615 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4015 |
+
2021-07-17 00:14:52,554 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4016 |
+
2021-07-17 00:14:52,555 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4017 |
+
2021-07-17 00:14:56,184 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4018 |
+
2021-07-17 00:14:56,185 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4019 |
+
2021-07-17 00:14:56,185 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4020 |
+
2021-07-17 00:14:56,619 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4021 |
+
2021-07-17 00:14:58,620 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4022 |
+
2021-07-17 00:15:00,621 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4023 |
+
2021-07-17 00:15:02,622 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4024 |
+
2021-07-17 00:15:04,623 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4025 |
+
2021-07-17 00:15:05,706 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4026 |
+
2021-07-17 00:15:06,624 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4027 |
+
2021-07-17 00:15:07,686 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4028 |
+
2021-07-17 00:15:07,687 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4029 |
+
2021-07-17 00:15:08,625 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4030 |
+
2021-07-17 00:15:16,327 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4031 |
+
2021-07-17 00:15:16,327 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4032 |
+
2021-07-17 00:15:16,328 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4033 |
+
2021-07-17 00:15:16,628 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4034 |
+
2021-07-17 00:15:18,629 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4035 |
+
2021-07-17 00:15:20,630 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4036 |
+
2021-07-17 00:15:22,631 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4037 |
+
2021-07-17 00:15:22,825 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4038 |
+
2021-07-17 00:15:22,825 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4039 |
+
2021-07-17 00:15:24,632 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4040 |
+
2021-07-17 00:15:26,633 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4041 |
+
2021-07-17 00:15:35,779 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4042 |
+
2021-07-17 00:15:36,517 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4043 |
+
2021-07-17 00:15:36,518 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4044 |
+
2021-07-17 00:15:36,518 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4045 |
+
2021-07-17 00:15:36,637 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4046 |
+
2021-07-17 00:15:37,637 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4047 |
+
2021-07-17 00:15:37,995 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4048 |
+
2021-07-17 00:15:37,995 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4049 |
+
2021-07-17 00:15:38,639 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4050 |
+
2021-07-17 00:15:39,639 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4051 |
+
2021-07-17 00:15:41,640 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4052 |
+
2021-07-17 00:15:43,641 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4053 |
+
2021-07-17 00:15:45,642 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4054 |
+
2021-07-17 00:15:47,643 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4055 |
+
2021-07-17 00:15:53,223 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4056 |
+
2021-07-17 00:15:53,223 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4057 |
+
2021-07-17 00:15:56,714 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4058 |
+
2021-07-17 00:15:56,714 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4059 |
+
2021-07-17 00:15:56,715 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4060 |
+
2021-07-17 00:15:57,647 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4061 |
+
2021-07-17 00:15:59,648 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4062 |
+
2021-07-17 00:16:01,649 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4063 |
+
2021-07-17 00:16:03,650 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4064 |
+
2021-07-17 00:16:05,651 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4065 |
+
2021-07-17 00:16:05,857 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4066 |
+
2021-07-17 00:16:07,651 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4067 |
+
2021-07-17 00:16:08,361 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4068 |
+
2021-07-17 00:16:08,361 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4069 |
+
2021-07-17 00:16:16,923 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4070 |
+
2021-07-17 00:16:16,923 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4071 |
+
2021-07-17 00:16:16,924 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4072 |
+
2021-07-17 00:16:17,656 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4073 |
+
2021-07-17 00:16:17,656 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4074 |
+
2021-07-17 00:16:19,657 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4075 |
+
2021-07-17 00:16:21,657 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4076 |
+
2021-07-17 00:16:23,511 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4077 |
+
2021-07-17 00:16:23,512 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4078 |
+
2021-07-17 00:16:23,658 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4079 |
+
2021-07-17 00:16:25,659 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4080 |
+
2021-07-17 00:16:27,660 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4081 |
+
2021-07-17 00:16:35,935 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4082 |
+
2021-07-17 00:16:37,195 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4083 |
+
2021-07-17 00:16:37,195 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4084 |
+
2021-07-17 00:16:37,196 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4085 |
+
2021-07-17 00:16:37,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4086 |
+
2021-07-17 00:16:37,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4087 |
+
2021-07-17 00:16:38,768 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4088 |
+
2021-07-17 00:16:38,768 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4089 |
+
2021-07-17 00:16:39,665 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4090 |
+
2021-07-17 00:16:40,666 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4091 |
+
2021-07-17 00:16:42,667 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4092 |
+
2021-07-17 00:16:44,668 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4093 |
+
2021-07-17 00:16:46,669 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4094 |
+
2021-07-17 00:16:48,670 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4095 |
+
2021-07-17 00:16:53,933 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4096 |
+
2021-07-17 00:16:53,934 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4097 |
+
2021-07-17 00:16:57,311 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4098 |
+
2021-07-17 00:16:57,311 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4099 |
+
2021-07-17 00:16:57,312 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4100 |
+
2021-07-17 00:16:57,674 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4101 |
+
2021-07-17 00:16:58,674 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4102 |
+
2021-07-17 00:16:59,675 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4103 |
+
2021-07-17 00:17:00,675 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4104 |
+
2021-07-17 00:17:02,676 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4105 |
+
2021-07-17 00:17:04,677 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4106 |
+
2021-07-17 00:17:06,010 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4107 |
+
2021-07-17 00:17:06,678 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4108 |
+
2021-07-17 00:17:08,679 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4109 |
+
2021-07-17 00:17:09,077 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4110 |
+
2021-07-17 00:17:09,077 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4111 |
+
2021-07-17 00:17:17,451 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4112 |
+
2021-07-17 00:17:17,451 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4113 |
+
2021-07-17 00:17:17,452 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4114 |
+
2021-07-17 00:17:17,683 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4115 |
+
2021-07-17 00:17:18,683 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4116 |
+
2021-07-17 00:17:19,684 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4117 |
+
2021-07-17 00:17:20,684 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4118 |
+
2021-07-17 00:17:22,685 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4119 |
+
2021-07-17 00:17:24,249 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4120 |
+
2021-07-17 00:17:24,249 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4121 |
+
2021-07-17 00:17:24,686 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4122 |
+
2021-07-17 00:17:26,687 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4123 |
+
2021-07-17 00:17:28,688 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4124 |
+
2021-07-17 00:17:36,085 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4125 |
+
2021-07-17 00:17:37,618 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4126 |
+
2021-07-17 00:17:37,618 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4127 |
+
2021-07-17 00:17:37,619 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4128 |
+
2021-07-17 00:17:37,692 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4129 |
+
2021-07-17 00:17:38,693 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4130 |
+
2021-07-17 00:17:39,429 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4131 |
+
2021-07-17 00:17:39,430 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4132 |
+
2021-07-17 00:17:39,693 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4133 |
+
2021-07-17 00:17:40,694 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4134 |
+
2021-07-17 00:17:43,695 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4135 |
+
2021-07-17 00:17:45,696 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4136 |
+
2021-07-17 00:17:47,697 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4137 |
+
2021-07-17 00:17:49,698 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4138 |
+
2021-07-17 00:17:54,582 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4139 |
+
2021-07-17 00:17:54,583 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4140 |
+
2021-07-17 00:17:57,806 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4141 |
+
2021-07-17 00:17:57,807 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4142 |
+
2021-07-17 00:17:57,807 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4143 |
+
2021-07-17 00:17:58,702 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4144 |
+
2021-07-17 00:17:59,702 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4145 |
+
2021-07-17 00:18:01,703 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4146 |
+
2021-07-17 00:18:03,704 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4147 |
+
2021-07-17 00:18:05,705 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4148 |
+
2021-07-17 00:18:06,161 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4149 |
+
2021-07-17 00:18:07,706 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4150 |
+
2021-07-17 00:18:09,707 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4151 |
+
2021-07-17 00:18:09,716 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4152 |
+
2021-07-17 00:18:09,716 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4153 |
+
2021-07-17 00:18:17,929 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4154 |
+
2021-07-17 00:18:17,929 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4155 |
+
2021-07-17 00:18:17,930 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4156 |
+
2021-07-17 00:18:18,711 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4157 |
+
2021-07-17 00:18:19,712 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4158 |
+
2021-07-17 00:18:21,712 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4159 |
+
2021-07-17 00:18:23,713 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4160 |
+
2021-07-17 00:18:24,846 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4161 |
+
2021-07-17 00:18:24,846 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4162 |
+
2021-07-17 00:18:25,714 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4163 |
+
2021-07-17 00:18:27,715 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4164 |
+
2021-07-17 00:18:29,716 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4165 |
+
2021-07-17 00:18:36,233 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4166 |
+
2021-07-17 00:18:38,094 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4167 |
+
2021-07-17 00:18:38,094 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4168 |
+
2021-07-17 00:18:38,095 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4169 |
+
2021-07-17 00:18:38,720 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4170 |
+
2021-07-17 00:18:39,720 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4171 |
+
2021-07-17 00:18:40,006 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4172 |
+
2021-07-17 00:18:40,007 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4173 |
+
2021-07-17 00:18:40,721 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4174 |
+
2021-07-17 00:18:41,721 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4175 |
+
2021-07-17 00:18:43,722 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4176 |
+
2021-07-17 00:18:45,723 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4177 |
+
2021-07-17 00:18:47,724 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4178 |
+
2021-07-17 00:18:55,183 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4179 |
+
2021-07-17 00:18:55,184 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4180 |
+
2021-07-17 00:18:58,229 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4181 |
+
2021-07-17 00:18:58,229 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4182 |
+
2021-07-17 00:18:58,230 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4183 |
+
2021-07-17 00:18:58,729 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4184 |
+
2021-07-17 00:18:59,729 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4185 |
+
2021-07-17 00:19:00,730 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4186 |
+
2021-07-17 00:19:01,730 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4187 |
+
2021-07-17 00:19:04,732 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4188 |
+
2021-07-17 00:19:06,309 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4189 |
+
2021-07-17 00:19:06,732 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4190 |
+
2021-07-17 00:19:08,733 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4191 |
+
2021-07-17 00:19:10,319 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4192 |
+
2021-07-17 00:19:10,319 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4193 |
+
2021-07-17 00:19:18,396 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4194 |
+
2021-07-17 00:19:18,396 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4195 |
+
2021-07-17 00:19:18,397 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4196 |
+
2021-07-17 00:19:18,737 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4197 |
+
2021-07-17 00:19:20,738 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4198 |
+
2021-07-17 00:19:22,739 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4199 |
+
2021-07-17 00:19:24,740 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4200 |
+
2021-07-17 00:19:25,542 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4201 |
+
2021-07-17 00:19:25,542 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4202 |
+
2021-07-17 00:19:26,741 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4203 |
+
2021-07-17 00:19:28,742 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4204 |
+
2021-07-17 00:19:36,386 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4205 |
+
2021-07-17 00:19:38,567 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4206 |
+
2021-07-17 00:19:38,567 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4207 |
+
2021-07-17 00:19:38,567 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4208 |
+
2021-07-17 00:19:38,746 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4209 |
+
2021-07-17 00:19:40,740 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4210 |
+
2021-07-17 00:19:40,740 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4211 |
+
2021-07-17 00:19:40,747 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4212 |
+
2021-07-17 00:19:42,748 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4213 |
+
2021-07-17 00:19:44,749 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4214 |
+
2021-07-17 00:19:46,750 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4215 |
+
2021-07-17 00:19:48,751 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4216 |
+
2021-07-17 00:19:55,882 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4217 |
+
2021-07-17 00:19:55,883 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4218 |
+
2021-07-17 00:19:58,677 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4219 |
+
2021-07-17 00:19:58,677 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4220 |
+
2021-07-17 00:19:58,678 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4221 |
+
2021-07-17 00:19:58,756 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4222 |
+
2021-07-17 00:20:00,757 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4223 |
+
2021-07-17 00:20:02,758 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4224 |
+
2021-07-17 00:20:04,759 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4225 |
+
2021-07-17 00:20:06,464 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4226 |
+
2021-07-17 00:20:06,760 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4227 |
+
2021-07-17 00:20:08,761 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4228 |
+
2021-07-17 00:20:10,762 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4229 |
+
2021-07-17 00:20:11,013 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4230 |
+
2021-07-17 00:20:11,014 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4231 |
+
2021-07-17 00:20:18,829 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4232 |
+
2021-07-17 00:20:18,829 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4233 |
+
2021-07-17 00:20:18,830 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4234 |
+
2021-07-17 00:20:19,766 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4235 |
+
2021-07-17 00:20:20,766 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4236 |
+
2021-07-17 00:20:22,767 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4237 |
+
2021-07-17 00:20:25,768 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4238 |
+
2021-07-17 00:20:26,199 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4239 |
+
2021-07-17 00:20:26,200 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4240 |
+
2021-07-17 00:20:27,769 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4241 |
+
2021-07-17 00:20:29,771 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4242 |
+
2021-07-17 00:20:36,538 DEBUG SenderThread:799749 [sender.py:send():179] send: stats
|
| 4243 |
+
2021-07-17 00:20:38,948 DEBUG SenderThread:799749 [sender.py:send():179] send: history
|
| 4244 |
+
2021-07-17 00:20:38,948 DEBUG SenderThread:799749 [sender.py:send():179] send: summary
|
| 4245 |
+
2021-07-17 00:20:38,948 INFO SenderThread:799749 [sender.py:_save_file():841] saving file wandb-summary.json with policy end
|
| 4246 |
+
2021-07-17 00:20:39,775 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/wandb-summary.json
|
| 4247 |
+
2021-07-17 00:20:40,776 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4248 |
+
2021-07-17 00:20:41,460 DEBUG HandlerThread:799749 [handler.py:handle_request():124] handle_request: stop_status
|
| 4249 |
+
2021-07-17 00:20:41,460 DEBUG SenderThread:799749 [sender.py:send_request():193] send_request: stop_status
|
| 4250 |
+
2021-07-17 00:20:41,776 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4251 |
+
2021-07-17 00:20:43,777 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4252 |
+
2021-07-17 00:20:45,778 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
| 4253 |
+
2021-07-17 00:20:47,779 INFO Thread-8 :799749 [dir_watcher.py:_on_file_modified():229] file/dir modified: /home/dat/pino-roberta-base/wandb/run-20210716_223350-8eukt20m/files/output.log
|
wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb
CHANGED
|
Binary files a/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb and b/wandb/run-20210716_223350-8eukt20m/run-8eukt20m.wandb differ
|
|
|