different initializations give you differently performing networks we already know this from things like you know a lottery ticket hypothesis and so on that the initialization can matter to some degree in these types of things now that being said they always train to the same it seems but their their score varies so I might be backwards correct here or not correct but in any case the initialization here matters more but also you can still see this linear relationship and this is particularly interesting this is even the case when