skysight-inc/HackerNews huggingface dataset:
>I do agree with you that memory and self-excitation seem like they are the last push thats needed to get to something more akin to "AGI"

"We show that transformer-based large language models are computationally universal when augmented with an external memory. Any deterministic language model that conditions on strings of bounded length is equivalent to a finite automaton, hence computationally limited. However, augmenting such models with a read-write memory creates the possibility of processing arbitrarily large inputs and, potentially, simulating any algorithm."

From "Memory Augmented Large Language Models are Computationally Universal"

https://deepai.org/publication/memory-augmented-large-langua...
US DoD already makes its own ammo
Wow - that's WSJ-branded content. Not the crowd that you'd expect to speak ill of corporate mergers and pricing power.
I'll give that it's reductionist, but that's kind of the point. Loans are investments, securities often are too as keys to liquidity and creditworthiness. Money is money, I'm not contesting that.

The question no one asked is if everything should be stockpiled.

I think there's no question that we should make things better or more plentiful.
I think they will use the really innovative iGlass :)
By training it with a LOT of data, I suppose.
Thanks for taking this avenue, the comparison to carpentry really annoyed me because all bathrooms or cabinets, or e-commerce/CRUD apps are the same right? (just because we're all tired of working on them doesn't mean our work is all copy and paste)

The most difficult part of any "hands on" job is time estimation - two people could give estimates of 3 days or 3 weeks on the same project and both be right.
great article :)

So then I guess what I'm saying is that ChatGPT has the same composability issues that DALL-E is known to have.
> In other words we can embrace the future without being cruel.

That's not "progress is necessary good". We're forming the future, our choices define the future, we're not damned to be powerless and either embrace what cannot be changed or suffer from resisting that which cannot be stopped.

Right now, lots of people are having their first experience that not all progress is necessarily good. It's fun to watch how they suddenly change their tune, much like banks when they need another bailout, and they start talking about "what's good for society" a lot.

> As far as affecting different people, LLMs are about to squish the middle class.

I'll believe it when I see it. We were promised widespread unemployment thanks to robotics, too.
Acquisition Talk blog spends a lot of attention towards fixing the Planning, Programming, Budgeting, Execution process in defense. There are many barriers for startups, the big one is getting the right amount of funding at the right time. It looks like creating the office of strategic capital is an attempt to solve this problem. Expect the defense majors, Boeing, Lockheed, Raytheon to lobby against this hard.

https://acquisitiontalk.com/2022/08/does-dod-not-actually-wa...
Product's construction complexity is irrelevant and always was. What matter is usability convenience of the end product.

Apple's products are selling not because it is easy to make them, but because it is easy to use them.

As an owner of BEV, this is massive PITA of current generation of electric vehicles.

* They are more expensive than ICE

* If you can't charge at home, EV's are massively inconvenient to own, especially when you need to fight with half-assed applications to control charging. Why am I using Another Stupid App (tm) to charge, when I need NO app to get gas?

* Charging takes ludicrous amount time compared to taking gas.

* If you are forced to charge on fast DC chargers, EV's are also more expensive to run than ICE
>with its psychological and visual impact, the calculator adds an entirely new dimension to such entertainments, transforming them into some of the most refined, stimulating, gratifying, inspiring, enjoyable, and spectacular entertainments ever devised...

Somebody really needed to get out more!
The linked video is from 2013
I thought I was using GPT-4, but it appears that's only available to paying customers so far? The question I was getting repeated wrong answers to was "Can you make up a palindrome that starts with 'Dude'?" If you want to try that with GPT-4 I'd be interested to see if it can do it now or at least knows to say "I can't".
Whether or not they could, I'm pretty sure they should.
I don’t know if that is true or not, but if so, I guess it is a stirring endorsement of the idea of being a nice liberal democracy that people want to move to.
Aicmd – Use ChatGPT to help you write shell commands without leaving terminal
Ads are redundant when the user is literally asking you what to do. You just tell them what to buy and they buy it.
Most of us are carpenters since carpenters don't build literally the exact same thing over and over either. They build similar stuff like decks and houses over and over. But they're all different to some extent. Programming is the same. The exact functionality is the different but they're all accomplished using more or less the same techniques.
There aren't that many FDIC coverage categories. I'd guess that individual sweep accounts would end up in the revocable trust category, the same as most "regular" accounts? Or maybe sweep accounts would end up in the individual ownership category while regular accounts (with beneficiary) would be in revocable trust? This seems like the kind of question that by the time you'd benefit from knowing exactly (rather than just being overly conservative), you're paying professionals to manage all this for you. There's no need to make an amateur determination that you won't know is wrong until it's too late.
If you want the basics then 2 cents by pbs is pretty good. I like the plain bagel on YouTube has he is very level headed and has his cfa and cpa
>since that's the sort of repeatable job that can be estimated

To some degree and depends on the job. Start opening up walls in an old house and tell me how cookie cutter it is. When I used to run shipyard jobs on offshore drilling rigs, I can tell you that every single job ran into all sorts of problems that were individually not predictable.

It's also just nonsense to think that most software is this uniquely open-ended snowflake. Most engineering jobs require problem-solving that can be affected by all sorts of things in the physical world--plus you sometimes just have to build and try out designs and maybe they work, maybe they need to be refined a bit, and sometimes you have to toss them out and start again from scratch.
Does anyone work (or worked in the past) for a defense contracting company? I'm curious what the environment is like (e.g. is it a pressure cooker using ancient coding standards where everything requires a bunch of people with shiny metal on their work uniform to approve?).

I worked for a startup where DARPA had given a fairly generous grant when I started my career (they made a medical training device that the military was interested in). I was jr, so I wasn't privy to the financial details of things, but overall it was very "waterfall-y" and a lot of form filling and box checking. WLB was overall pretty fair, but the key thing is that processes really hamstrung everyone (think MISRA style of coding standards) and morale was rather low. Pay wasn't great either so I left.

I just wonder now that I am more senior and have more financial responsibilities, is defense a financially safe space in case more tech keeps RIFing, even if overall comp levels are low.
If only the task that the estimate is for would not change much after the estimate has been given.
Ah, interesting. I suppose that's a lot like what psychologists or psychics try and do, convince you to prompt them without you noticing.

Reminds me a bit of an old demo where you're trying to measure a certain signal shape in the presence of heavy noise. You get shown waveforms and decide if it looks like there might be a signal present or not, and the ones you approve get averaged to pull the signal out. Very quickly, even if all you are shown is zero mean gaussian noise, the average of what you OK'd starts to look like the waveform you're looking for.
ChatGPT is not 4 years old, it's a newcomer, give it some more time, ok? It's still developing, it's not a final product. There is already a huge difference between GPT-3.5 and GPT-4. Next iterations will be able to do more and more, especially if they get tools, self-reflection and vision.
>There are no signs of diminishing returns just yet though

Sure about that? GTP-4 doesn't seem 5 times better than 3, much less 10x. Despite having 5/10x the parameters.
20 years ago I carried around a palm pilot, iPod and cell phone. I was so happy when I could combine all of those devices into an iPhone. I just don’t see a need for VR googles at this point. This seems like a solution in search of a problem.
Linux is Making Apple Great Again
The layoffs will continue until (investor) morale improves
For me, it's the unnatural sounds of civilization. The beep beep beep of trucks backing up or construction equipment, leaf blowers, or helicopters flying over while I'm on a nature walk.
im sure any init script has similar issues if (like systemd in this case?) not updated for a while
I think what’s fascinating about GPT developments is it may very well emulate part of our left brain hemisphere. As McGilchrist pointed out, with lots of research and studies on people with brain damage strokes etc. is that it is the left hemisphere that sees the world from an internal representation. Right hemi. sees a car as the "thing in itself" in direct experience (colours etc). The left hemisphere makes it into a category of "car", now removed from direct experience.

And just like gpt’s data set isnt necessarily truth, so is our own image of the world which as we know can be deeply distorted through abusive childhood, cults etc. In fact, all of human knowledge is simply beliefs, agreed stories about reality. For example "red" is a word/sound that points to an experience. The word alone only has meaning in context (what GPT can handle), but can never substitue for a conscious experience.

Crucially imho, software will never be able to do what the right hemisphere does. And I find it dumbfounding that even Lex Fridman doesnt see the fundamental difference between conceptual thought / language based reasoning, and direct experience aka consciousness.
Still reduces to to the same thing. Doctor? You’re extending the life of people who sell shit. Teacher? You’re training future shit sellers.

The entire industrialized economy runs off of extracting resources to create stuff.
Not everything will be replaced, but you can extrapolate that much of what we do will be replaced.

The thing that is harder to replace is the versatility of the human form. Manual labor can't fully be replaced because robotics have yet to catch up.

>there's no need to reject the inherent value of humanity

There's no fundamental rejection here. Capitalism simply selects the most efficient methodology. If humans arent the most efficient methodology for a given task then capitalism eliminated that methodology. That's the logical extrapolation. You subjective opinions on humanities worth is irrelevant to the most likely outcome.
Yes, though the end user has no control over that knob...the corp end can turn off split tunneling and it's off by default.
The toxin doesn't taint the meat?
I'm an Apple user and love all things VR / AR, probably spend 10hr/wk using Quest 2.

Tempted to get the Reality Pro/One on launch, but at $3k and the tech team saying that not only will there be nothing exciting software-wise at launch, but a cheaper version and a more advanced version are on the horizon (no pun intended), I can't justify getting it.

If someone like me who is basically the perfect demographic crossover doesn't want it, not sure who will... but time will tell.
In quantum physics, we also don’t really understand anything („shut up and calculate“) still people build awesome stuff that works.

Humans learned how to use and create fire looooong before understanding what fire actually is! Just a few centuries ago, people believed that fire is its own element!

Feels kinda similar to people searching for „consciousness“ that „understands“ things as if it would be something special/magic… when it’s probably more like naturally emerging behaviors when scaling up neural networks?
It would be cool for one of these folks (or anyone really) to show us why these things won't work. I see people I respect in that thread but I'm also very tired of hearing about how trivial these things are and not seeing someone spend, according to them, very little time to bypass these things.

Obviously, I'm not smart enough to do it or else I'd be doing it. However, I'm not going around making wild claims either. I think something like that would help rather than hinder OpenBSD.
I expect a plumber to give me an estimate of time and cost for his "tasks" before starting work. Even if he doesn't tell me the exact cost upfront he'll still be able to tell me roughly if he'll be done in 2-3 hours or less/more.

If I have a big project and I'm dealing with a plumbing company I might not be talking directly to the plumbers but to their manager. The manager will usually ask for time/complexity estimates from his plumbers before sending me a quote. The manager will usually factor into the quote any risks plus the company's profit margin.

There's a lot of talk about agile, scrum, no-estimates and so on, but a big part of the software industry still works with time estimates and budgets communicated up front.
Neither of those things are true? The books being banned are not pornographic?
Why would you say this in time when people are getting laid off left and right? We need to provide jobs for everyone who is already here. The F visa is a non-immigration visa to begin with.

Additionally, we need to deal with people who come to our country and then only exclusively hire people from their country of origin. I can point to the page of multiple Chinese professors in the US who were trained by Americans in American universities, then start their own labs in American universities and only hire Chinese graduate students (and I’m not talking about labs of 2 students, I’m talking about massive labs of 15 - 20 students). Our country is getting taken advantage of and the last thing we need to do is give away more visas.
Salt lake city is not a sparsely populated rural area, and its suicide rate is about the same as the state's overall rate (24 vs 20.8).

Could be some altitude effects as a sibling comment observed, though SLC at only 4200 ft isn't in the Denver range.

But Utah also had a large rise in teen suicide over times that align also with the social media hypothesis: https://utah-health.shorthandstories.com/state-of-suffering/...

(It went from already high to awful)
Similarly: the tear through my a Achilles tendon brought a tear to my eyes.
> So how do we fix it?

I don't think we can, at least not while preserving its value. For one, english started as basically a pidgin or creole from the british isles being invaded by so many groups over centuries, so we're not starting off at the best place. Two, the other examples of spelling reform I'm aware of are either from highly centralized places (the French empire), or small groups of countries that border each other (German spelling reform). There's not really a way to get the US, UK, India, and parts of Africa to agree on how something is pronounced (and therefore agree on what the proper spelling should be).

The only way to "fix" it would be to have each country (or region within a country potentially), reform the language in a different way, which would destroy most of the value of having so many people in disparate places speak that language and be able to communicate.
Job posting is available at https://filthydreams.org/wp-content/uploads/2023/02/View-Job... and the original story is at https://filthydreams.org/2023/02/16/i-found-it-the-worst-art...
Our Feckless Fealty to Twitter
What a joke every teenager knows how to cloak themselves with a VPN to evade parental access restrictions & new tech will emerge to thwart all these laws! Google builds infra to make sure your kids have 24/7 access to YouTube! I know I used to work there! The only restriction we could impose at our house was to turn off the router at midnight!

I freaking HATE google / YouTube for filling my kids' childhoods with Smosh videos instead of real books or high quality active play.

And yes my son flunked out of college because of online social media - twice! He's got ADHD which makes him a perfect target for the addiction phd psychologists employed at social media and videogame companies! For these online tech vampire companies addicting your kids is like shooting fish in a barrel! And yes I'm a cs phd who got my start in network security!

As a left-wing free speech parent STILL STRUGGLING against online addiction with a 21-year old son who is STILL spending 24/7 to waste time online I'd put the threat up there with : hard drugs & gambling addiction. Yes it's that severe for a not trivial part of the population. YOU HAVE BEEN WARNED!
All of their other wearables and phones are waterproof at this point, why wouldn't this one be? Rinse it off in the sink when you are done!
>Huh? The iPhone 1 was a toy and lots of people laughed at the users.

Nothing "toy" about it, it was the most advanced phone on the market. The people who laughed were just the handful of idiots that would laugh because "Apple, har har har" and then go buy the same thing from another vendor. The same kind of Zune buying crowd.

>Today a modern phone is a requirement to be a member of society.

You'd be surprised.

>It is how I pay for things. It is needed for most of my interactions with friends/family. It is the diary of my life, and the repository of my good memories with its near unlimited video/image storage at a quality only dreamed of when the iPhone 1 came out.

None of those are essential, even for a 21st century level lifestyle, some of those are indulgent, others are detrimental. In any case, nothing revolutionary, except if one thinks "I can pay by taking out my phone and pointing it at the gizmo at the cashier" is something far great than "I can pay by getting out my credit card and pointint it at the gizmo at the cashier" (or, god forbid, giving cash and not being tracked).
this assumes that there’s a buyer of software, and that the buyer decides which software to build. In those cases estimates might make sense
But in many other instances (product/engineering led companies, start-ups) software isn’t built for a buyer, it’s build for a user - and a user doesn’t care if it took 5 days or 15 weeks to build their favourite feature. What they care about is that you build features those users actually want.

In those cases estimates form part of a whole basket of mechanisms and rules designed to ‘shield’ developers from users and vice versa, which imo is among the biggest mistakes one can make in such software companies.
The gaps in US/China arms will never be closed by startups...no startup is going to start churning out Columbia-class subs or F35s.

We screwed up and lost decades on crap like the Zumwalt class, the LCS and numerous other boondoggles that easily cost us a decade and $100 bln++. The LCS really deserves special mention for a unique level of stupidity - we are scrapping them pretty much as they come off the line. Its crazy - we don't want these ships, have committed to scrapping them...and we're still ordering them! Only in America.

Let's not forget how much we built and burned in Iraq and Afghanistan. How many subs and carriers could have been built with the resources squandered? We sure did buy a lot of Humvees that never came back.

Even without those epic failures, it isn't clear we could beat the Chinese in manufacturing. Throwing bodies at a problem is definitely in their wheelhouse.

While we were bombing, they were building. Now we get to deal with it.
It's interesting. I'm the same way but I've had friends from the city who are distracted by the sounds of nature in the southeast. The crickets and birds that are always gabbing. I assume it's just whatever your brain associates with background noise!
Hi Author here

> Perhaps it is true that worries about space leaks or surprising performance are overblown. But I think that any apology for lazy evaluation in Haskell should attempt to understand and argue against the reasons that someone like SPJ would say ‘the next Haskell will be strict’. (I’m not totally sure what the reason is; maybe it’s just that lazy evaluation is unpopular)

You are completely right. The type (b) of space leaks that are a correctness concern must be addressed. I was intending to do a second post about it.

I have a classification of space leaks that gives rise to defensive patterns to avoid the class (b). In general space leaks come in two varieties:

- Strictness space leaks: there is thunk that to be evaluated need to enter another thunk and another and another, usually growing in size. If we had evaluated in the reduction we could have collapsed the layers accordingly. The classic "foldl' vs foldl" leak is of this kind.

- Liveness space leaks: There is a reference that is kept alive because is needed to evaluate a thunk. If we force the thunk, that reference is marked dead and collected.

Type 1 of leaks are a property of functions with recursive calls or functions are that are binding expressions (such as >>=). They are local property leak. Type 2 are a global property and the more common kind. Obviously seq appropriately on a strict monad solves the issue. I will do another blogpost discussing the defensive patterns.
I'd probably argue that any accurate estimate almost has to have some slack built in. For any task of any complexity, especially one requiring coordination, things rarely go more easily and quickly than you expect. Far more likely, you run into problems or you really need to talk to a person about something and they're on vacation.
Give them a break, they're venting but they're raising valid problems within the workplace (don't go by the headline alone). I've personally been in this spot and had to seek outside help to identify issues within my workplace!

They key is negotiations, and both parties being able to balance a moving target of requirements and scope. Large software development is not a determinable thing as much as we would like. Perhaps ChatGPT will solve this?

>> I wonder if the person asking the question would be happy to let someone do a job in his home with an uncapped budget and timeline?

Even this is not always accurately determinable! If you've had work done in your home, or heard anecdotes from others, you would realize this.
Football 17776 (2017)
ChatGPT's partial answers were helpful, yet the whole process was time-consuming. I guess that googling for it would have taken at most 5-10 minutes, but I wanted to see how ChatGPT behaves.

But Bing on the other hand, it didn't even bother to spit out ChatGPT-like sentences but only pointed me to some non-helpful Stack Overflow entries.

I just re-logged-in into Bing to search for my query, I found it in the history and re-visited it, now it is handing me out an answer which looks like it was generated with ChatGPT, but it's still the same buggy code. Chatting with it shows the same problems which ChatGPT has.

I wonder if GPT-4 could give me the correct answer (manually displacing the vertices, not in a shader).

Wow, now after chatting and then performing a normal query and then going back to the chat-mode, the entire chat history was gone...
You don't seem to understand what a lie is. You are uncharitably interpreting statements made during an evolving situation.
CSS-Only Widgets Are Inaccessible