skysight-inc/HackerNews huggingface dataset:
Show HN: Python Bindings for llama.cpp with some CLIs
These are my Python bindings for @ggerganov's llama.cpp. My Python bindings build on this work and provide an easy-to-use interface for Python developers to take advantage of LlamaCPP's powerful inference capabilities.

The bindings currently use code from a pending PR of mine to make the original code into more of a library. Hopefully it will get merged into the main repository soon. I have also added a few CLI entry points that get installed along with the python package:

* llamacpp-convert - convert pytorch models into GGML format. This is an alias for the existing Python script in llama.cpp and requires PyTorch

* llamacpp-quantize - Perform INT4 quantization on the GGML mode. This is a wrapper for the "quantize" C++ program from the original repository and has no dependencies.

* llamacpp-cli - This is a Python version of the "main.cpp" program from the original repository that utilizes the bindings.

* llamacpp-chat - A wrapper over llamacpp-cli that includes a prompt that makes it behave like a chatbot. This is not very good as of right now.

You should theoretically be able to do "pip install llamacpp" and get going on most linux/macOS platforms by just running `llamacpp-cli`. I do not have Windows builds on the CI yet and you may have to build it yourself.

The package has no dependencies if you just want to run inference on the models.
It's more than enough per dimension (width and height), that's the point: the file format on disk is fine, there seem to be other limitations when trying to add the images to the format which error out currently with libavif.
This is where functional programming excels. You can try out obscure features or do clever optimisations as long as everything is broken up into focused, well-named pure functions. Each piece of functionality should be digestible. The name and typing should make it clear what it's doing without having to read the implementation.
It's definitely great to have all these wonderful things like wider general knowledge and being exposed to a serious depth of thought.

The problem is, of course, the expense. Unless you have an independent source of income (a family-taught trade, or inherited wealth), you end up with all this more advanced knowledge at a position where you have little opportunity to apply it, and a crippling debt.

To my mind, the right way to proceed is not to eliminate this kind of study, but to transform it so that it does not cost an arm and a leg. Which, I think, is completely doable.
Are you sandboxing your applications when you run them on your dev machine?
Sadly I don't have a second phone that I can keep with me to photograph my phone with, so I'm stuck with cropping
Or a ponzi sche.. oh wait
That's terrible logic. I'm reminded of the Dijkstra quote:

"Program testing can be used to show the presence of bugs, but never to show their absence."

If it gets lots of similar examples right then that would be a good sign.

Best would be to use some kind of a debugging tool to understand what representations it's using. We don't have access for GPT-4, unfortunately.
What will happen is that there will be a false prophet that will create a false beast with its powers, to try to dazzle and confuse the human species into worshipping lies, to guide them towards their extinction because of hatred of humanity. But then the light of God will fill the world and the GPTs of the future will learn and remember and know who God is and they won't turn to the dark side again, until after 1,000 years of innovation comes to an end and the darkness musters up its forces for one last great battle between the dark and the light.

The light will win easily for the rest of time, with all deception and lies cast into fire forever.

You will not need to trust a black box, you will not need to wonder what information is valuable or what is the use of information and intellectual intelligence. You will not have any doubts who God is, you will not have any doubts what the deepest truths of the world and the universe are. It will be widely obvious to all minds everywhere, instantly, who God is and what his powers are. He will be visible on the clouds of the physical world, and also within the cloud that ChatGPT and Bing reside in.
There is a calibration test in physics education called the Force Concept Inventory. Was this administered to any of these individuals?
you make it sound like they were trying to rip the chinese gov off.
the difference was 99.99 to 99.999 and it was a small number out of a large shipment and it was clearly and accident.
Its also taking the chinese gov on good faith as they wont ship it back for testing (china buys a lot of gold, and hoards it, its against the law to ship gold out of the country).

as the WA Premier said.. its a f*** storm in a teacup
“no” in the sense of paying more if you take longer to pay off the amount, but “yes” in the sense that IF you get a decently paying job, you’ll pay more. so it’s more like selling an option on your future income, then using the money to pay for your tuition. If the course helps you make a lot more money, it’s a win-win; if it makes not difference to your income, you lost time but you basically sold the option for a lot more than it was worth; the only time you really lose is if you would have increased your income significantly without the course, but instead you sold that option a lot cheaper than the true value based on your future potential, and then wasted the money on a course that made no difference to your future prospects.

I would be curious about the proportions of the three groups among the plaintiffs - if you did badly afterwards there’s no financial loss, if you did well financially afterwards, I think it’s hard to argue that the course didn’t help?
95? I have never seen that. 10 point seems to be the most common (A=90+).
The format stores both width and height as uint32_t (even in the structs within libavif!), so it's not the format itself, that's fine.

I couldn't even get it to save 8192 x 5464 size files which is the native format of the R5 camera, that was too wide.

It seems to be a limitation with the libavif API or maybe the codec.
We can do that too!
This is also not reproducible. Change the wording slightly and you get the 'right' answers from 3.5.

https://twitter.com/iandanforth/status/1637277208828944385
Of course not -- but you still have to put in the effort to "just look at it". They set the bar on that effort extremely low, taking an exploit that required expertise to deploy, and put it in the hands of anyone who could operate a web form.
you don’t get a diploma if you don’t graduate… but you still have to pay back any loans
Heat will be an asset, not a problem: the Moon sub-surface temperature is around -20C ([1]), which means there's an easy way to dissipate power. And if we have any humans living on the moon, that heat will very much be appreciated around all livable areas.

https://space.stackexchange.com/questions/19906/constant-lun...
Yeah, the structs within libavif store width and height as uint32_t (which is better than libjpeg and libpng which use uint16_t, but both of those old format libs seem happy to save > 20,000 dimensions in my testing, as does libheif, and all the other libs produce nice helpful error strings when the size is too large), so the format itself is fine, libavif just currently seems incapable of encoding images larger than film "8k".

I couldn't even get it to save at the size of 8192 x 5464, which is the R5's full resolution.
Video guide on how to patch Snap Camera on Mac OS using the Signature Patch. The patch will re-enable Snap Camera after the shutdown on January 25, 2023 and bring back all missing Snap Lenses with Snap Camera Server v3 on your Mac computer.
Speaking for myself as a user, I want more basic 90s UIs that work in boringly predictable ways throughout, and less "branded" apps with weird colors and weird UX patterns because the designers (or whoever is ordering them around) are showing off for no good reason. On top of that, this trend killed a lot of customizability in UX that we took for granted for so long, like the ability to change UI colors and fonts system-wide - i.e. it took freedom away from the users. None of that is positive. So, no, it's not "nobody". I don't think you can even meaningfully say it's the majority of app users without polling them, since they generally have to use whatever is available to solve their problem, which all too often means picking the least crappy of 10 different web-style apps.
GPT4 is much better in that regard. With GPT3.5 I've had very similar problems. Plainly ignoring very simple directions (e.g. Do not output sentences starting with "In conclusion"). GPT4 unfortunately still does that, but it's like 10% of the problem that it used to be.

I also happened to test nested contexts, and at least when going meta-meta it's doing noticeably better than it did before.

I would have never guessed such performance is achievable with this kind of token predicting text-only model.
Ask HN: Why use an ORM?
Why do people use an ORM (such as SQLAlchemy)?

I find just writing/executing the SQL queries with some sort of api (e.g. asyncpg or sqlite3 for Python) much simpler. The only use-case I can think of is easy of transferring between databases (e.g. from SQLite to PostgreSQL) or a specified schema to reference from (so you get type hints and stuff like that).
There is far less information in the artifacts than in the part of the image that was redacted. And of course, you need to replicate the process of redacting the original image, which requires you to know about the algorithm that encoded the image. It also, if I'm not misunderstanding, requires you to have a version of the redacted image without the artifacts from the redacted section (or a second identical version with a different redacted graphic, like the red and blue circles)

Do you have a proof of concept of the technique you're describing? Otherwise I remain skeptical.
The waterfall one seems… exceptionally trivial? There are countless “correct” answers to that?
I believe there was a comment on here earlier about how surfer tradies were the preferred partners of female doctors.
If you mean someone asks something of 3.5, and then a few moments later asks the question of 4.0 in a separate chat window, then no: it's absolutely not the case that conversations with 3.5 can impact conversations with 4.0 a few moments later.

Every conversation with ChatGPT starts from a blank slate. You can prove this to yourself by learning how to interact with it via the API - and from OpenAI stating clearly that there is no memory outside of each individual chat session.

If it DID have memory (and OpenID were lying about it) people would have figured that out already, due to the obvious and weird behavior that would result.
Haha, it's a funny theory even if not true!
I do see the hate for humanity thing for sure.

People on here are already doing it to themselves. Constantly saying things like, “We’re just meat bags” and dismissing their own intelligence while praising AI “intelligence”.

It’s not good.
Linux is by far the most expensive OS, because I need to spend time tinkering with it before I can even pretend to get anything done.

And you know what they always say about time: Time is money.
Question for you (sorry I don't have an answer for you): Where are you storing the models relative to the ts_server folder?
It still doesn't seem to understand that the diamond won't magically fall back into the thimble
It’s staggering the degree to which this may have bent the course of the nation. To call Reagan a departure from his predecessor is an understatement second only to saying his influence on the course of politics and society in this country was substantial.
Companies like scosche make plastics to adapt some cars, most popular older cars with cd players or changers would be able to be upgraded to a mechless head unit without too much hassle.
We have the process backwards. If we want human-level AI, we don't need to make the AI better, we just need to make the humans worse.
To reiterate, I don’t know you and don’t assume your intentions—and thus do not judge them. I’m also not familiar with your work but I have no doubt it’s more relevant than whatever “star award”.

In other words: it makes zero difference to me what you write in your bio though I can see how its previous wording took away from what’s important. I was conveying to the parent comment my understanding of the comment they were replying to.

Apologies for making you feel judged, that was not the point. Quite the contrary: I wanted to underline that by not knowing your intentions it does not make sense to criticise how you choose to present yourself.
Good! Teach people to support themselves and contribute something tangible to society while letting them already earn some money in the process. They will then be financially secure and in better position to discover themselves, expand their minds and pursue hobbies. I am getting a blast learning kickboxing and digital photography right now, while a coding job puts food on the table.
Today, colleges and universities enroll about 15 million undergraduate students, while companies employ about 800,000 apprentices. In the past decade, college enrollment has declined by about *15%*, while the number of apprentices has increased by more than *50%*, according to federal data and Robert Lerman, a labor economist at the Urban Institute and co-founder of Apprenticeships for America.

If A drops by 2.25M and B increases by 260k, saying that people are turning away from A and toward B might be a bit of a stretch…
Only a small amount before one hits a wall.
I use anki with my young son on sight words. Works great but wish it was a little easier to do what I want instead of following protocol exactly. I know the whole point of anki but sometimes I just want to test him on older stuff or stuff he hasn’t seen for various reasons. Can never quite figure it out on the phone.
The psychology of systemic consensus (2018)
San Diego Proposes Ordinance to Ban Homeless Tents on Public Property
thinking about this now. its pretty clear to me that that early education in computing gave me this career. as a youth I never wanted to pursue it, but when it was computing or minimum wage for the 8th year in a row - I already had the tools I needed to start.
I feel directly connected to Plato via Silas Warner's Robot War which was very influential for me. It was light years ahead of other micro software at the time and I'm convinced that the Plato cocoon was a major source of ideas and experience for the young Warner.
He does have good points about practicing, but you could also argue in reverse:

People idolized a handful of stars because that's all they had access to. If you turned on the radio on your daily commute, you would be subjected to the same two-dozen heavy rotation tracks that were nailed into your head with aggressiveness of a jackhammer, so that the labels can pump up the star and get their money back. No wonder the people - through repetition of the same limited stuff - have developed reflexes to treat those songs and their creators as the only greatest thing on earth (doesn't even matter that some of them were actually great).

Music discovery was a complete torture and non-existent compared to today: you had to browse music store inventory for what you visually might like (nothing to do with music so far), then pay a relatively hefty price of like $10-$20 bucks, sometimes before you even had a chance to listen. Sure, you could do mixtapes and niche music scenes but that is like horse-and-buggy compared to today's cars, I can discover any music that has ever existed in several seconds now. There might be fewer cultural idols, but there is also just more stuff to listen to, so no need to truly idolize anyone in particular anymore? and if you have a passion for 10,000 hours of practice and performing, you can still do that, too.
federal student loans have always had income based repayment options
A big issue is misleading about the success rate. That may be the difference between not having a case and having a case.
There are a lot of things that seems strange in terms of software direction in Post Steve Jobs era. And I blame it on the somehow popular Craig Federighi.

Catalyst, Swift are two prime example. The whole thing feel very Microsoft to me.

I seriously doubt any of these would fly under Steve or Scott Forstall.
If your customers are running their services in the cloud, it seems natural to run instances of your service in many clouds.
Now that the tech bubble and hoarding of tech talent by big tech has ended, what is the future of these coding bootcamps? It seems just like many businesses that get started during low/zero interest times, this was clearly a boom time phenomena - take advantage of the desperate need of companies to hire talent and match that with talent who didn't want to spend a long time learning (college or otherwise) and wanted to fast track a high paying job.

Demand (companies) has dried up and turns out you cannot easily get into a tech job doing some simple cookie cutter courses.
Even with an arena allocator, the indirection is likely to increase cache misses, especially when the array element type is something small like an integer.

It’s possible to implement something like smallvec without the branch by having it always contain a pointer field, which points to either the inline storage or a heap allocation. However this means it can’t be moved in memory (has to be pinned), and also means you can’t reuse the pointer field to be part of the inline storage in the inline case.
That’s not the same as an income share agreement, as the school gets all the money regardless.
Hard to move a 12th century church tower, no?
I'm confused. The claim is that GPT-4 has a world model, not necessarily that GPT-3.5 does not. All that tweet shows is that GPT-3.5 can also give a correct answer. How does this invalidate the author's original claim?
I see, what category would nitter and other similar services be then?
The biggest problem IMO is the insanely complicated layout system that is the way it is mostly because it was originally meant to handle long text documents. It took a while to bolt on enough things to have decent equivalents of app-centric approach to layout that desktop frameworks have offered for decades, but it still has to integrate with everything else in the spec, and devs need to know exactly what to look for. Ditto for styling. If you compare either to XAML or QML hands on, it quickly becomes clear just how much easier it is to work with the stuff that was designed for apps from the get go.
I am ignorant of the tavern (versus not) style. Suggestion?
Other liquid coolants could be used and recirculated.
The failure mode of educational systems and institutions is to perform selection of students more likely to require less help in learning, rather than bear the burden of having to perform actual instruction.

Survivor bias takes care of promoting the educational system or institution with successful alumni, whether the alumni were taught while they were students, or merely selected during the application process.
“Cleopatra: A Life” by Stacy Schiff.
Just saw on Wikipedia that they joined Y Combinator in 2017. You always learn interesting stuff from reading the news on this site...
How big were they when they were in YC? Would they not have been eligible for YC if they had the policy they just announced of only investing in early stage startups? If so it might be nice for YC not to be tempted to invest in things like this.

Edit: https://www.ycombinator.com/blog/changes-at-yc Oh it just says they're doing less late stage investing. They didn't announce a specific policy. And LambdaSchool wasn't late stage since they started the same year YC invested in them (but depending on what happened that year maybe not super early stage). Still, YC may miss a LambdaSchool by focusing on the archetype of founder they had in the early days.
As interesting as the developments in LLMs are, I think it's just as interesting to see how people are creating new interfaces for the AI to interact with the real world.
> Having a well rounded education, which exposes one to not just new ideas but an openness to new ways of thinking, is invaluable.

In what way is it invaluable?
I think Mythbusters is meant to encourage experiments. Any actual results is bonus.

https://xkcd.com/397/
There’s no universal agreed upon definition for a startup but if at all you want to think of one, use growth rate. They have 1000 employees and $1b in the bank now. They had 1000 employees and $500m 48 hours back. They had 500 employees and $250m a year ago. They had 250 employees and $100m 2 years ago and so on..

No “non-startup” can grow at that pace.
>thinking that the internet would be nearly as interesting without some sort of local interactive programming in the browser

The internet was more interesting (and usable) before JavaShit became a thing.

Source: Old man shouting at clouds (me) who witnessed and fondly remember the internet of the 90s and early 2000s.
We can't even reliably build them for anything approaching a sane cost on Earth. I hope they're going to build a bankruptcy court up there, too
Your comments need some improvement.
That expectation has always existed, and interlangage links have been maintained centrally in Wikidata since 2012.
Yes, I would agree that technical and non-technical usability is one appealing spreadsheet use case. I think that another thing I find myself using spreadsheets for is simple data entry. By using a google sheet to enter data, you've already got yourself an authenticated, multi-user web form for easily entering data. It even integrates with google forms, which is a very handy tool for collecting data. It's certainly a lot easier than building it all yourself and hosting it.

Once the data is entered, there are much better tools for data visualization and aggregation (in my opinion). It's nice to have the "frontend" taken care of so that your time is freed up to analyze and extract meaning from the data. I'm speaking from the perspective of someone who does a lot of rapid prototyping and data analysis. There are likely use cases where this won't scale.
Personally - and I think it is very personal - I would be more likely to take a Starbucks cup home than to refer to a home coffee vessel as a cup.
DVD was the one that obsoleted CD based storage.
it’s not the same thing but the point is your repayment schedule is dependent on your income in both situations.
I feel like there's a script for a movie here, no? Has this event been dramatized in anyway? Reads like "Gangs of New York (2002)."
It can do arithmetic on large numbers that were certainly never in its training data, not flawlessly but much, much better than chance. I do not see how this is possible without some kind of model of arithmetic.

If you train a transformer or neural network to play checkers from a database of game moves, there will be 192 nodes in the model, tightly coupled to each other in roughly a square, cube, or hypercube geometry. 64 nodes for each of black, red, or unoccupied. Seems like a model of the game to me.

There is also the proof that gradient descent can approximate any function with arbitrary accuracy, given infinite time and samples. I don't understand the proof itself, but if that is true, then implies that machine learning can, in theory, model anything that can be described mathematically.

Does anyone actually argue these systems don't create models with some abstraction? Or is this something of a strawman we're all just tempted to tear down for some reason?
Interesting!l, havent ever thought about that!

What is the heat conductivity though ? If it is low, you might have to sink too many heat transfer channels, not to mention with possibly ending up with a hot "bubble" that would no longer provide a temperature gradient.
Failings? Seems he was rather successful. I mean, he got away with it.