skysight-inc/HackerNews huggingface dataset:
I love that you found/acknowledged Type 3. Type 3 is a super easy trap to fall into, especially when you don't understand the problem space.

I think the only way you can avoid that is by almost annoyingly probing to find the root of problem (because it is often some broken or stupid human process). Most of the time, it does not require more software to fix, and the problem is to do with process complexity. If you can simplify that, any software you write will be more minimal.

So yes, the problem as always is with people IMO and having to educate/convince them to change their ways (or at least, open their eyes to a different solution). I guess this makes me a Type 2 as described by the article (although it naturally oversimplifies each archetype).

What some people might not want to hear is that, yes, I think you unfortunately can only excel at problem solving as an engineer if you also are good at the "product" management part.

I have a way more controversial opinion in industry that is a bit spicy... I think if you aren't coding the solution to the problem, you shouldn't be allowed to define the solution or get anywhere near it. In other words, even to my favorite PMs I've worked with - I think your job exists because many engineers are anti-social and don't want to talk to people. For the ones that do collaborate well, a PM is unneeded on the team and would be a detriment. It's not a personal knock - I just believe that to be the truth. The original agile manifesto got it right and we have collectively fucked it up.
That's the point of having multiple realizations of the same underlying model.

The (depthwise) convolutional realization is extremely efficient for training, and the RNN is extremely efficient for inference. The scaling in both of these cases is much better than attention layers - as they discuss in the article.
It's true that Kotlin wasn't a breakout success 5 years ago. However, I would argue Kotlin's design decisions made it destined for its current success, whereas Dart has not.

The most obvious of this was same-build compatibility with Java. Mixing Kotlin and Java made it super easy to switch, and made using it a no-brainer vs other solutions. Android Studio also has a button that auto-converts Java to Kotlin, so in many cases a wholesale rewrite isn't even necessary.

At this point, Kotlin has also become a goto for backend Java for stream processing and other open-source JVM projects. It's rapidly replacing things like Scala for Flink, as an example.

Maybe Dart survives by the sheer force of will of Flutter, but I don't think there's a chance it catches Kotlin.
My favorite part of boxing is that it’s a very honest martial art. If you punch the other person more than they punch you, you win. Even the most technical coach will tell you that all the technique and philosophy we train is just there to improve your chances.

When you’re in the ring, forget the theory, do what works (within the rules). If your instinct says to throw a weird punch at a weird time, do it. You probably saw an opening.

I also like that boxing is full contact. No amount of katas or whatever will teach you as much about yourself as getting actually punched in the face will.

Similar to how no amount of analysis can beat actually shipping software and seeing what customers say.
Seems the same problem that TeX has been solving really well since several decades ago. Hyperlinks included
That's a contributor to the repo, not someone with commit access.
You might be thinking of Accenture, which was founded from the ashes of Andersen Consulting.

Andressen is one half of Andreessen Horowitz (a16z) which (I think?) doesn't have any connection to Enron.
It definitely is still a thing but it has evolved substantially due to competition from containers, tankers, and dry bulk ships. Nowadays break bulk is almost exclusively for things that don’t have even a remote possibility of breaking down into container sized chunks.
I used to be a naval architect, and I completely agree with you. This type of design is extremely inefficient for cargo delivery. I think it is unrealistic to expect to be able to even remotely compete with diesel cargo ships. As another commenter said, the crew are in fact paying passengers (I have not verified this) which means this is actually a cruise ship, which makes a lot more sense. It must be a great experience.
In my mind, the only way sailing ships can come back as work boats is if a way is found to make them nearly automatic and space efficient. In my mind this means large steel ships, not dissimilar to regular cargo ships, but with automated kite sails (e.g. https://skysails-marine.com/) as they do not tend to tip the ship over like regular sails do.
I struggle to understand what insight is gained from this article. Can anyone explain how this could be useful?
Is training a model on second-hand data laundering copyright? Second-hand data is data generated from a model that has been trained on copyrighted content.

Let's say I train a diffusion model on ten million images generated by diffusion models that have seen copyrighted data. I make sure to remove near duplicates from my training set. My model will only learn the styles but not the exact composition of the original dataset. So it won't be able to replicate original work, because it has never seen any original work.

Is this a neat way of separating ideas from their expression? Copyright should only cover expression. This kind of information laundering follows the definition to the letter and only takes the part that is ok to take - the ideas, hiding the original expression.
It's funny how big the difference feels between 3.5 and 4 but also feels subtle. Like it's just doing what I expect it to versus seeing the limitations more clearly in 3.5.
Before I read the article, my first reaction was "People. Research grants pay for people('s salaries)." (And other things as well, but that's usually the biggest category)

But apparently, in the author's university, a massive amount of goes to "overhead". That's quite surprising, in my opinion.
Hubble Sees Possible Runaway Black Hole Creating a Trail of Stars
if "leaks" are true then even a 65B model is a toy when GPT-4 is supposed to be 1000B
I would really like to have an open source model that could compete with even gpt3, but basically all lammas I tried failed to create correct email validation regex, where gpt3 is able to even refer to what rfc it is
4 dimensional triangles are the same as 3 dimensional lines. They don’t exist in the 4th dimension any more than they exist in any dimension >= 3. You would need a fourth side/point in the polygon in order for it to have any position in that dimension.

(It could be a triangle in dimensions 2-4 from our perspective but to the triangle it only has 3 dimensions any way you arrange it.)

Or you can bend a triangle in another dimension(s), but then it’s not a triangle by the commonly accepted definition. (E.g a 270° “triangle” on a sphere)
If I’m remembering correctly, Google refused to support YouTube on Fire TV. They could’ve done a lot worse imo. They own Google Search and Play Store
TLDR battery storage can replace grid inertia (“ancillary services”) historically provided
by thermal generators (coal and various forms of fossil gas). This is a distinct service/capability from energy arbitrage and has its own revenue stream.

South Australia (where the Hornsdale Power Reserve was installed) runs a minimum of 80MW of fossil gas generation to provide these services (in concert with synchronous condensers), and this year the grid operator AEMO plans on lowering that minimum further, approaching a point where they’ll allow running on renewables and batteries alone around 2025-2026 (once a new interconnector with adjacent New South Wales is complete).

https://reneweconomy.com.au/remarkable-south-australia-may-s...

(also of note are new capabilities in battery and solar power controls that allow them to form grids independently vs simply following existing grid reference)

https://reneweconomy.com.au/aemo-to-fast-track-grid-forming-...

https://www.sciencedirect.com/science/article/pii/S235246772...
Let's suppose that the datasets don't increase in size. Look at the difference in speed between the old ChatGPT and turbo ChatGPT. Suppose within 6-8 months they can do that again with GPT4.

I think that would be about five times faster than a human.

But there is more data. Do you really think they have ingested every single YouTube video or movie? Video and video+transcription is the next thing.

Another source of data could be to have the models study and reprocess information into more concise language (possibly new vocabulary) or diagrams with the goal of increasing levels of abstraction or information density.
No, I honestly didn’t know about it! I should have googled it before making my comment… Thanks for letting me know.
The move back to one’s own computers isn’t causing layoffs. If anything it’s a sudden slowdown in overall IT spending.
Nah, you'd write some kind of metapackage called something cutesy like lamp that had a TUI that took you through it.
I assumed it was just a 360 camera, but I have no idea how they kept it unfrozen.
I feel like these aren't always personality traits, but rather often indicate the kinds of work environments one has been exposed to.

I would characterize myself as more of a "Martial Artist" at heart. I find creating quality code gratifying for its own sake. I have an academic CS education. The majority of my early career was spent at a mature organization with lots of process in place and a reputation for engineering excellence. I love tools engineering and other internal work that makes others more productive, rather than the trench warfare of supporting consumer apps with thousands and thousands of users.

Yet, over the past two years at startups I feel I have taken on a lot more "Street Fighter" characteristics in order to cope. I let objectively bad code slide in reviews if it puts out a fire or we won't scale to meet its limitations soon. I fix serious issues and operational headaches under the table, because they would fester for months unprioritized otherwise. I start talking directly to management at the year mark instead of waiting for raises, because most startups just don't bother setting any expectations at all on that front.

It's important to realize that not all Martial Artists will be that way forever. And your organization might be what makes them hang up their black belt and pick up some brass knuckles. Or vice versa - a Street Fighter might tire of building and rebuilding half-baked spaghetti wire solutions and decide to go somewhere they can just focus on one thing and collect a paycheck.
It will be very hard for other database engines to keep up if this gets implemented by cloud vendors. MySQL would get marginalized further and further not just in the relative lack of SQL features, but all the easily available add-ons the community will inevitably write for Postgres with no viable answer from its competition.
What's amazing to see is the effort to attempt to run the models on consumer-grade hardware, going as far as running 4-bit quantized models on phones or raspberry pi. All the debacle about mmap optimizations to llama.cpp [1] and the style these were committed to the product is a great testimony of open source. Both in the positive aspect (progress) and the negative ones (visibility affecting human judgement and collaboration). The sheer amount of experimentation is also providing a standard interface for different models that can easily be integrated and tried out.

[1] https://github.com/ggerganov/llama.cpp
The problem with continual taxation
like that is that the kind of entities that collect taxes become less trustworthy over time. So maybe the expenditure starts out as beneficial to the people, but over time it fails to corruption.

So then you get this situation where everybody knows that the taxes are doing more harm than good, and somebody really ought to do something about it, but nobody wants a discontinuity of government because their property is justified via taxation by the old corrupt one.
Channel 5 and 6 LPTV stations are being given the opportunity to upgrade from secondary spectrum user (that could be forced off their frequency) to primary spectrum user (that can't be forced off their frequency). So the option to use channels 5 and 6 just closed, as those frequencies are now used in most markets.

I can't think of one major US market off hand that does not have a channel 5 or 6 station.
Google Interview after my first university year for a masters internship (might not have been the best idea in the first place).

Got asked how to manipulate a collection, showed the interviewer 10 different ways how to do something, each time a bit different as he rephrased the question to get me to the result he actually wanted to see (I knew what it was but tried to be snarky, if that's the right word).

Actually fucked up the right answer at the end because I lost track in the process...

Also forgot that remove(obj) will actually iterate through the whole list each time it wants to delete an element if the element was added last..

The other interview was even worse because communication was bad.
Yikes, you (singular) just got rather uncivil. Such a shame, as you (plural) were doing so well.
This is part of why I can see copyright extending past an author's death. For many it takes a lifetime to pay off monetarily. For some artist's they don't see any success until death.
Anecdotally yes.
It underlies the broader sense of hopelessness and pessimism a lot of people in this generation feel in terms of never being able to afford things like housing.
Going from "why can't I afford to live anywhere?" to "maybe I should try to organize" is not a particularly hard jump to make if you already feel so hopeless in your ability to move up by other means. Especially in modern retail / restaurant jobs, they're fucking brutal for the pittance they try to pay out. Really no wonder organizing feels like the only outlet to improve those jobs in particular considering how those companies like to treat their "peons".

For hard numbers, a Gallup Poll made in the last year shows 71 percent of all Americans approve of labor unions more generally, the highest it's been since the twilight of the New Deal Coalition in the mid 1960s.
Source: https://news.gallup.com/poll/398303/approval-labor-unions-hi...
Martial arts for the projects, street figthters for the products.
Good engineers are always valuable but everyone shines differently in different situations.
> Some of the stuff coming out of GPT-4 is clearly some sort of intelligence that's beyond human level, in speed at the very least, and often in quality.

Hm erm, what? No, just no, not barely.
Could you quantify "quite slow"?
Nuts, Bolts and Meccano
To make talent sourcing and hiring decisions.
>>> A very stressful part of faculty life was knowing that my annual compensation was about to take a nose dive if I don't get another grant.

>>> ... What do you do if you're swimming in funding then? You can buy out of teaching. You effectively pay for the cost of an adjunct to take your teaching load.

Indeed, people think that getting tenure means you can live on easy street, but a tenured prof with no funding is living a tough life. They can lose their research space and department-contributed equipment funding (if in a laboratory science, these can be significant), and travel money, plus get "stuck" with a heavy teaching load. At the same time, a prof who does want to focus their career on teaching pays a price for doing so.
Julia seems to be doing a better job catching up to R in this space than Python. I haven't used it personally, but the demos of Genie Framework are impressive: https://github.com/GenieFramework/Genie.jl / https://genieframework.com/
A base model Nissan Versa is $15k MSRP. They have other models in that range.

Or you can get a new Toyota Corolla for $21k MSRP, which is close enough.
We’re still talking about Y Combinator valuations
Deepmind is headquartered in the UK (but owned and funded by Google). Graphcore are also UK based.
What this also shows is the degree of control that a single company has over the market. At a time where GPT-4 is integrated into products while others are on the waitlist, competition can move far ahead of a company that's just trying to gain access to the technology w/o clear insights on the prioritization approach. As said, there just are no alternatives at the moment, so to a degree competition is skewed.
It's in developer mode, but the MMC is probably dead : the restoration fails with some "unknown error". I could give the Gallium OS fixflag recovery a try, though!

I don't really care about the internal drive; I could probably use the SD card slot to host an OS instead.
is uncertain, as with codding you need white room methods to prove that new code is not contaminated with patented implementation, as it might be here, so basing anything on an existing model could be also copyrighted.
Can you name ten?

Would be a nice short.

On a side note did all the "big" names collapse already (SBF from FTX, CZ from Binance, Do Kwon)?
Agreed re: B2B, but I've looked at a handful of the Webapp / PWA solutions for B2C app store and it's still pretty far away.

B2C users really demand a consistent experience despite the state of the device, and it's hard to get a web stack to do this well. Logical offline behavior is one, but even things like the click response being slightly too slow vs native UI can turn people off.

Beyond that, you hit the same problem with RN / Ionic: Native plugins don't work as well, native support isn't there, and it becomes very hard to debug. This is especially true if you "present" the app to the user as native but use a web stack. For a website in a browser users tend to have patience for things like slow buttons, for native they do not.

As a point of comparison, think about how responsive a game engine can be. That is the user experience people expect on mobile. It's a heavy lift to get web there, and if you don't someone else will build a native experience that will.
Yes, that matches well my experience with NSF (in astrophysics).
Most goes to the University in overheads + grad student + (maybe) postdoc, and a little bit to cover your summer salary (which is an insane concept if you ask me).
Check out Line War, fwiw
Ashburn, Virginia: Data Center Alley (2020)
Nice, I had kindof given up on thinking they would open this up, but someone here mentioned a couple weeks ago that VMSI were waiting on compilers or something.

Can't wait to try this out later this week, I haven't used VMS in years, and never had to install it... gonna be interesting.
As a UK-based web app with very American users, I've noticed a few visitors coming from Ashburn, Virginia and wondered why. It seems this might be the answer, or perhaps one of the ISPs located there.
I'd imagine it's the difference between businesslike sorry-not-sorry stuff like: "We're sorry to inform you that we are not moving ahead with your application", and actually trying to apologize to someone. The not-actually-apologetic stuff is basically just normal parts of polite speech for the culture, actual apology with emotion or intent to make redress or request forgiveness is very different.
I wonder why they wouldn't use a catamaran for a more modern version giving the ship more speed. Perhaps the center support would be prohibitively heavy?
There is value in industry rumors and speculation, but come on even official Tesla product announcements are basically rumors.
https://www.farmersalmanac.com/parmentier-made-potatoes-popu...
I think that package is still pretty early days, but does show promise. I was speaking less to the code and more to the ecosystem.

If I tell someone they should use Streamlit/Dash/Shiny for Python, how do they get started? The beginner onboarding experience is horrible for someone without an existing programming background. Download Python, maybe instruct them to setup a "virtual environment", use this "pip" thing to install these packages, point them at a way to edit code, and try to give them a way to launch it. God help them if want to share their work. Huge amount of existing resources assume Linux by default or that people have any idea how to use Docker.

While I hate...basically everything about the R ecosystem, the beginner experience is leagues better. Download RStudio. It will setup R, install packages, and has a big button that will launch the Shiny application. Straightforward guidance on how to get it hosted on an existing provider.
i used VMS in the very early 80s, when i was working at a college which was part of the university of london. i never cottoned on to it - that versioning file system (obviously designed to sell hard disks) and all that SYS$SYSTEM stuff (i mean - why?).

and then i changed jobs somewhere else, using a dec-10, and discovered what a really horrible OS was like.
If you’ve raised venture capital, you have to pay yourself
The PyDPainter project is not me in any way. Just adding some context for those who may not "get" why Deluxe Paint is considered by many to be historically notable.
The AI doomism will help no one. Bing search is a good example. Very good simulation of an average human. Sometime same as hysterical as humans online...
The thing is it is a simulation. The AI however smart it will be, will miss something very important for someone to want to eradicate humanity. It will miss the "will" and the erratic harmonal storms of our body and brain. It will miss the drive to want something. On the other hand, a good simulation of an average or even psychotic human on an AI capable to make this simulation smarter then all other humans, can be dangerous to humanity. Thus: STOP FEEDING AI with our biases and behavioral data, stop feeding it with the chat data and the literature data and the tones of online trash which is posted every day all around the internet. Stop feeding it with the data which will make it possible to simulate an average human. 32K context and possibility to focus on 3-4 key-points of the conversation now, will soon (like 2 years from now) change and will turn into 64k and 7-8 key-points. This is still not enough to build a long term strategy to eradicate humanity.
It could be, but it’s not. Optimal speeds for cargo ships are going to be their hull speeds, which are usually between 12 and 18 knots, but these ships are typically traveling 25+. Ships often exceed their hull speeds because short times from port to port is more profitable than saving fuel. They could save 2-4x on fuel costs, but lose far more than that in revenue.
actually, sail boats and steam boats coexisted for many decades. Sail boats were used for grain and coal transport well into the 20th century, though as steam engine technology developed, on fewer and fewer routes. But it's only the internal combustion engine that made sail boats obsolete for shipping.
They're both global professional advisories with a ton of similar services and competing for similar clients. They ought to be thought of as basically body shops for management consulting.
A token per second-ish with a Ryzen 7 5800X. If I run it for too long it gets slower as heat throttling kicks in, I need a better cooling system if I'm going to run it non-stop.
You just described a jazz musician. ;-)
“set by their human masters”

Why does the human have to be in charge? Once someone sets a swarm of AI bots on a path, it can easily become a grey goo scenario.

And even if it isn’t, the bot can simply stop listening to the “master”.
Complex math of counterfactuals could help Spotify pick your next favorite song
Exactly, Ada is searched for 2x as much as TS? No way.