skysight-inc/HackerNews huggingface dataset:
I need Y Combinator's Organization ID
I'm signed up for AWS startup program and I need Y C's organization ID to activate my credits for development work.
All of these smaller model paradigm suggests that we need to incorporate pruning into model training. Neat was one of my favorite algorithms of all time. Same thing with BitNet models which keep showing the information you need is not that much for neural networks. And again, it is same with us, we use much less energy than a regular network so there seems to be immense waste of energy training these models.

My intiution tells me the pre-training paradigm will shift immensely in near future because we started to understand that we don’t need all these paramaters since the subnetworks seems to be very robust preserving information in high dimensions. We keep saying curse of dimensionality but it is more like the bliss of dimensionality we keep seeing. Network redundancy still seems to be very high given BitNet is more less comparable to other LLMs.

This basically shows over 50% of the neural net is gibberish! The reason being is that the objective function simply does not include it.

Again my intiution tells me that neural scaling laws are incomplete as they are because they lack the efficiency parameter that needs to be taken into account (or simply left out due to greed of corporate).

And this is what we are seeing as “the wall”.

I am no expert in neural network theory nor in math but I would assume the laws should be something in the vicinity of this formulation/simulation:

https://colab.research.google.com/drive/1xkTMU2v1I-EHFAjoS86...

and encapsulate shannon’s channel’s capacity. I call them generalized scaling laws since it includes what it should include in the first place: entropy.
Not this time. I was quite sincere.

Let's take names. I have diacritics in mine and an appalling number of computer systems can't handle them properly. Should I drop them completely and loose a part of my language in the process? Or deal with more □? firstName + lastName is another, where our idea of naming is forces on to others with a different system.

Dates. The US sets weeks from Sun-Sat and much of US software defaults to it, even when it should know that in my locale Mon-Sun is the default. In some cases I can't even change it. And don't get me started on MM-DD-YYYY.

Processes. Talking to a human is easy. There is leeway. A computer says no. Now I have to conform.

More broadly, we humans do fantastically well with ambiguity. Modelling ambiguity is tricky, after all, computers are extremely fast morons. So that ambiguity gets lost.
No Code > Low Code > Large framework that does everything > Small framework > Library > No library

Every item is faster to implement and less configurable than the next one.

Until the set of features you need to implement fit your current choosen setup, you're good. If you need to dig deeper, you'll be in pain.

You may get some relief with some hooks.

I've experienced my fair share of pain with RoR, it's definitely not a magic bullet.

I was amazed at things like Rails Admin a decade ago but overall it does way too much for what I typically need.My sweet spot is a low level server, eg. node.js + express (actually, rust + axum these days).
Looking for Foundation Engineering video lectures? Dive into this essential Civil Engineering subject with Magic Marks! Access high-quality, engaging video content covering topics like Soil Exploration, Bearing Capacity, Shallow Foundations, Deep Foundations, Earth Pressure Theories, and Retaining Walls. Learn at your own pace with expert guidance, interactive visuals, and detailed explanations. Perfect for students aiming to strengthen their concepts and excel in exams. Join Magic Marks today for the complete Foundation Engineering learning experience!
> They probably just use the local power grid

A lot of EU datacenter providers specifically pick green electricity providers/sources, and pride themselves on it, and use it in advertising their sustainability.

Scaleway in particular are 100% no-CO2 (they have it easy, most of their DCs are in France where it's easy to be fully nuclear+renewable). Hetzner are the same.
It's not quite like that.

Maths content is the ne plus ultra of conceptual.

It's totally possible to slog through a chapter of a maths text and feel like we got it. But it turns out our 'understanding' was a facade. We can't apply the concepts in a new situation. Exposing ourselves to feedback via problem sets reveals this.
People are playing this game and apparently deriving enjoyment from it, that's why they're paying for things in the game. I don't think it's fraud, it's just kind of weird from the outside.
But nowhere near as clickable a headline
A quick Web search seems to indicate that's either a) not actually a CVT at all, or at best b) a planetary gear used as a power-splitting device to connect electric and ICE power sources to a conventional CVT.

So this compares rather favourably, by actually being a geared CVT, which Toyota's "eCVT" apparently isn't at all.

Sources:

https://eahart.com/prius/psd/ (From: https://news.ycombinator.com/item?id=39566938 )

https://www.youtube.com/watch?v=O61WihMRdjM (Long, 39 min!)

Ooh, aah, now I get it (I think): Yes, the output RPM of the "eCVT" is indeed continuously variable. But that's just how all planetary gearboxes with two power inputs (as here, ICE and e-motor) work: The output RPM is a function of both the input RPMs, a (weighted) average of them if you will. So you can vary the output RPM while holding one of the input RPMs constant, simply by varying the other input RPM. Here Toyota presumably wants to keep the ICE working at the most economical RPM, while allowing the vehicle to move at varying speeds, which they achieve by varying the RPM of the electric motor. (In practice, Toyota uses two electric motors, but AFAICS the principle also applies to just one. TBH I'm not sure why they need two, but then I'm only halfway through that long video.)

So yeah, the "eCVT" is kind of "a CVT", but only if you have two power sources simultaneously. It can't apply a continuously varying gear ratio from just one power input to a power output, which is what is usually meant by "power transmission".

TL;DR: This can vary the gear ratio from a single power source to your wheels; Toyota's "eCVT" only works for hybrids (or other systems with two independent power sources).
> So is this the expected workflow?

It's impossible to write what is the expected workflow, because that heavily depends on your requirements. Overall there is certain functionality that exists in diesel and that can be combined in different ways to build different kind of workflows.

For example: If you have a database that is controlled by someone else you won't want to use any migration functionality at all, you would want to use only `diesel print-schema` there to generate the `schema.rs` file for you. Similarly different workflows consisting of any of the existing parts are possible.

> So, in this sense it seems very similar to SQLx.

There is an important difference here: Diesel provides a operate CLI to generate rust code for you, instead of connecting to a database from the "compiler" (or reading files). That's really important as you don't have any non-deterministic proc-macros, which are really not that great with the rust compiler (and officially something that's at least in some grey zone in terms of support).

> My take is that this is a "database-first" approach vs rust-query's "code-first" approach to safety. I think the benefits of a code-first design are that you don't need any additional CLI tooling, manual procedures outside of code, to test migrations, or a running database at any point in development.

This brings me back to the non-standard workflow point raised before. You also can have a code first approach with diesel. The cli tool supports generating the migrations for you from the given `schema.rs` file and a up and running database. So you basically would write the `schema.rs` file in that case and the tool generates SQL to move the database to that `schema.rs` state.

> > that has the disadvantage that it forces rust-query to always have the full control over the database
>
> I think this goes for any database layer, doesn't it? If you write migrations for Diesel and then someone goes and makes manual changes to the production database you're similarly out of luck.

My point here is more: rust-query really forces you to have control over the database. Diesel is totally fine with not being able to control migrations or whatever. For running code you only need to provide a schema.rs file, which might be generated by running migrations or which might be hand written or which might be generated from an existing stable database.

> The rust-query author also mentions checksumming, but I think at the end of the day people always have the ability to go in and hollow out assumptions - but IMO the code-first approach which discourages any manual database interaction draws a clear line.

That's likely only about migrations, not about the actual database state. It can help to make sure that migrations are really the same as used to setup the database, but it won't help with cases where you change the database manually. I don't think it's even meaningful to check on each database interaction that the schema hasn't change so far, as that would be quite expensive.
Not OP, but- it seems OP is looking to test an idea and not paying unnecessary costs or setting up unnecessary entities abroad, exploring possible options for paying less does not mean she/he 'does not have the stomach for that kind of a gamble'- why pay more when you can pay less?
0/0 might be a specific number. You have to go and use l'hopitals rule to work out what it might be.
They are similar. I remember cataloging the differences, once, but that was a long time ago.

I don’t think sparse checkouts let you “mix and match,” the way virtual repos did.

Think of the files in the virtual repo as “symlinks” to their originals, in other repos.

Other than that, SourceSafe was kind of a nightmare, and I don’t miss it.
Regardless of Star Citizen being a huge scam, a Hackernews encountering a site that does not look like all the b2b SaaS sites and being surprised that it managed to raise money is extremely funny.
I’ve never seen a low-code solution work at all.

I've worked quite a bit in civil engineering and GIS, and most places I've worked at have made very good use of a 'low-code' tool called FME for automation and ETL tasks. I even reach for it myself for many tasks, even when I am fully capable of doing exactly the same task using for example Python. For the right tasks it is simply the most productive solution.

That being said even with these tools you still need to know how to 'program', at least conceptually, and it's not like just anybody can pick up a tool like this and be productive. The basic concepts of control flow and algorithms still apply and work the same way.
In my experience noone bothers unless they are using GPUs or they are already at 100k/mo.

I do think 100k/mo is the tipping point actually, that is $1.2M/yr.

It costs around $400k/yr in engineering salaries to reasonably support a sophisticated bare metal deployment (though such people can generally do that AND provide a lot of value elsewhere in the business, so really it's actual cost is lower than this) and about $100k/yr in DC commitments, HW amortisation, and BW roughly. So you save around $700k a year which is great but the benefit becomes much greater when your equiv cloud spend is even bigger than that.
Orthogonal to the music theory itself, there's the question of general learning methodology.

One approach that seems promising is combining spaced repetition with knowledge graphs. The graph helps map knowledge areas and dependencies. For instance:

- Notes depend on Pitch.

- Intervals depend on Notes.

- Chords depend on Intervals.

...etc. The system would ensure concepts are mastered in the right order before progressing and use spaced repetition [1] to determine the optimal intervals for quizzing the student.

A site discussed on HN previously outlines how it applies this approach to teaching math [2].

Also, check out Hookpad [3], which offers some innovative tools for learning music theory.

--

1: https://en.wikipedia.org/wiki/Spaced_repetition

2: https://mathacademy.com/how-it-works

3: https://www.hooktheory.com/
Video Games Can Improve Strategic Thinking
Video game development, particularly on advanced platforms like Unreal Engine, offers a unique opportunity for entrepreneurs to enhance their strategic thinking. The intricate process of turning ideas into playable games teaches valuable skills in planning, resource management, problem-solving, adaptability, and teamwork—skills directly transferable to business leadership. By exploring game design, entrepreneurs can sharpen their decision-making and approach challenges with a more creative, systematic mindset.
Look, I understand that some people are short-sighted and can hardly think out of the box and that is totally fine by me. I don't judge you for being that so I kindly ask you not to judge my question. Learn to give some benefit of the doubt.
It's very evident this is the case if you generate similar JavaScript or TypeScript.

The types mismatching can really help you spot mistakes early on instead of at runtime, plus with the LLM generating trivial boring types is very straightforward.

The same effect is visible in Rust too and you'll quickly catch APIs that don't exist or that are being used incorrectly - albeit LLM understanding of Rust is really bad compared to other mainstream languages
Yes, I belive it can, but that is not the only problem. A large quantity of metallic particles may block GPS signals which are already very weak.
My kitten had iron-deficiency when he was doing that. Maybe worth a quick check/ask and with a little bit of dietary change or a supplement the problem could be addressed.
China is actively working on reducing their emissions (they're building tons of nuclear and renewables, and have long term plans for both), and a lot of theirs are to manufacture stuff the whole world uses.
Space Engineers is still to date my favourite space sim of all time. It has a steep learning curve and is ideally played with a few mods (encounters etc), but even stock standard it’s such an incredible game that only gets better the more you play it.
To be honest, I think the biggest difficulty this game faces is that at this level of funding and this time amount of development time, I'm not sure you can actually make something that lives up to the hype. From what I've heard the stuff that's implemented so far is pretty good, albeit buggy. And the team definitely has the skill to make something amazing.

But you don't want decent or even good from a project that's spent over 12 years in development with over $700 million of development costs. You want a genre defining masterpiece that puts pretty much everything else in the genre (or even industry) to shame.

I'm not sure it'll be possible to deliver that, at least to the degree you'd expect from a game this expensive. At a certain level of development time/costs, expectations become so high that it's almost impossible not to disappoint everyone with the finished product. And I think Star Citizen passed that point a long time ago.
it feels like it would be hard for those to tile at all, let alone aperiodially
Is UK-based bank account one of requirements?
Ideally, yes. And I agree that there's some correlation of how well clearly people can write prose and write code. But, articulating yourself with your teammates is not only about writing well. It's also about saying the right things. I have seen many engineers that write code well, can write a paragraph in English well, but just don't communicate enough and don't communicate the right things at the right time etc.
Didn't Biden say that he would never show favoritism to his son, since has a "commitment to the rule of law and judicial system". The White House PLEDGED several times that they would be NO pardon for Hunter Biden even he if was convicted. They even mocked the journalists who asked this question - several times.

Looks like the Biden Administration was made out of absolute lies and shameful hypocrisy, but the folks who didn't have their heads in the sand knew that anyways.

Oh yes, do blame this on Trump - the real reason is that there was the threat that Hunter would take a plea deal and reveal all dirt on his father - esp the corrupt dealings in Ukraine. Made Biden's Puppeteer's terribly shiver. Ukraine has been a money laundering operation for a long time now - don't want the gravy train exposed.

Expect to see a very large surge of preemptive pardon's issued in the next month - easily several times more than the previous Trump presidency - and nearly all issued to the corrupt members of the current administration.
What would happen then if someone wants to make a movie about a book published a few centuries earlier? Would they have to do deep archaeology to find the heirs of the author, the heirs of the heirs, the heirs of the heirs of the heirs,... and then get permission of the hundred-odd heir^Nths?
It's marginally better compared to Claude and costs 10x. O1 is not a solution.

I agree there is plenty of space for improvement on the IDEs side, they need to start fetching code of dependencies and documentation dynamically, get the relevant context and pass it in the prompt to the LLM, so that they can use real code and not what the model remembers from training a certain library does.
Sudo will temporarily get you in su, whereas the cu command calls another user within the original shell. Designating kernel privileges within an instantiation works in the absence of a w-r permissions setting scheme for designating cron tasks + programs.
The conclusion to draw there is that Shakespeare honestly doesn't make for very good reading today unless you are also delving into the historical context or considering the major impact of his works on humanity's culture from the arts to language. LLM generated output has none of that.

'Ah ha! LLMs are better than Shakespeare!' is a meaningless statement.

Besides, no one reads Shakespeare for pleasure; there is no need to generate more. ;)
No, the US is the main country that loves these messages. Have you seen the size of universities or the government ? It's just clerical staff doing make believe work. Go to any .gov website. They'll throw up a wall of bs before you log in (e.g., https://ttp.dhs.gov/ ).
I surely will :]
Love this, though:

> at the end of the day, you have one voice. Humans are single threaded [..] there’s only one word that can come out of your voice at a time.

Try listening to Mongolian throat-singing. Also try stress-induced stuttering, where at best you can only force out a byte or a nibble, only rarely a word. Or, at the other end, constant worry that you’re not a you you’re a we, and we forgot to install a reentrant lock on the voice box of me.
Reverse engineering the Ravensburger TipToi pen
The idea way to install PostgreSQL extensions?
A good example of how no money can guarantee a timely quality release. It only makes people lazy when they realize they have decades of time to waste.
RRobotomy
One of the most visible features of a cat: its hair. Imagine a startup for cloning your cat, except you can change some features. It can start with hair color. After some rounds it might add size, eye color, hair or no hair, chubbiness. You name it.

It may start in any BRICS country, and then expand! Tourist trips to cat cloning resorts. Check our CATLOG!
Better link: https://en.wikipedia.org/wiki/Actor_model

CSP is a bit different from the actor model (see the comparison section in the page you linked).

The biggest difference is that CSP communication is synchronous.
There's another advantage:

Humans and human language have co-evolved to be compatible. Language makes no such allowance for the needs and quirks of LLMs. (However to a certain extent we design our LLMs to be able to deal with human language.)
So we're not losing our jobs?
Thank you for sharing your thoughts!

> it’s supposed to make writing faster code easier and more automatic
Agree with this viewpoint. I suppose that makes it compiler-like in spirit, though much simpler.

I also agree that waiting for input/updates is a cost. What still surprises me, is that you seem to be able to do something differently with intrinsics, while believing this is not possible as a user of Highway.
It is indeed possible to call _mm_fixupimm_pd(v1.raw, v2.raw, v3.raw, imm), and the rest of your code can be portable.
I would be surprised if heavy usage were made of such escape hatches, but it's certainly interesting to discuss any cases that arise.

I do respect your decision, and that you make clear that raw intrinsics have higher upfront and maintenance costs. I suppose it's a matter of preference and estimating the return on the investment of learning the Highway vocabulary (=searching x86_128-inl.h for the intrinsic you know).

Personally, I find the proliferation of ISAs makes a clear case against hand-written kernels. But perhaps in your use case, only x86 will continue to be the only target of interest. Fair enough.
AMD Radeon series ≥6800 & ≥7800 have 16GB VRAM too.
Believe me, no one identifies users by UA at the moment, it's pointless and even fingerprintv4+ does not do this.
Thank you for taking the time to read this already long thread.

> Honestly, I hate this take. I don’t think it’s good for science or academia
I completely understand, I don't say that I like the system as it is, just that we are stuck in it because there is no real alternative.

I would also love to have experts reading papers, but the sad truth is that it is often a first year phd student doing the review outside of its field.

> The question then is how people enter a topic.

I really like the idea of encouraging PhDs to write blogs and supporting material for their paper, or at least reference to good quality blogs that lead them to insights. But it takes time, time that usually they don't have, teaching assistants in particular spend most of their time working with students, projects to follow, etc..

If you have a solution to how to do it properly I'm interested. I had myself some ideas on how to solve this, but it would require time and money that I don't have.

> We are hyper focused on this novelty thing but in reality that doesn’t exist and is highly subjective.

Thanksfully I don't work on fashionable research, of course I have some people working on fashionable dl, but we stay focused on the why and not just putting boxes one with the other and hope it works.

> The math often __is__ the insight.

When the math is the insight, it should be there and followed by the insight in text and analysis. I don't say don't put math, but put interesting math. Nobody cares about copy pasted math from any other paper, with possible mistakes inside.

But I keep my view, the math is a mean, but ultimately what we want to transmit is the insight behind, the math can be recreated at will when the insight is there.

I love math, and some fields are more mathematical than others, and they profit from it.

> We let the bureaucrats take too much control and dictate the universities.

Agree totally.
> The autosegmentation jumps frequently between adjacent sheets, so is not yet precise enough to reveal contiguous texts, but it coarsely follows the entire scroll.

Maybe a stupid idea, but has anyone tried to make a new scroll with known content and markers/known coordinates, and then cook it so as to bring it to a state close to the ones we're trying to unroll. And then scan it, and use that to fine-tune the software?

There are probably simple insights that are extremely difficult to discover when looking at an entirely new problem, that would become more obvious when one already knows the original inside out.
I would bet that at Oxford the word that is most important, but never spoken out loud is "relevance"
which they are grasping at
A good part of this thread just ignores there "naming" and gets on with having fun with language, without them.