skysight-inc/HackerNews huggingface dataset:
Plexiglass: A toolbox for testing against adversarial attacks in DNNs and LLMs
Hi everyone, my name is Enoch and I am a researcher studying deep generative models.

I've started this project called Plexiglass a while back, which started off as a torch toolbox for adversarial research in DCNNs. I am now rebooting it as a toolbox for testing against adversarial attacks in both DNNs and LLMs.

Idea is to test your DCNNs against adversarial attacks such as fast gradient sign method and toxic prompts in LLMs.

I would very much appreciate contributions, I need more devs as I'm too busy to do this all by myself .

Repo is here: https://github.com/kortex-labs/plexiglass
A few months ago, I received an email about my huggingface token being exposed. They've sent the same email to me a couple times now and I got a bit annoyed as I shared the token on purpose as read-only to my repositories which were all public anyways. I've responded every time with no response.

I was originally gonna post a Tell HN venting my annoyance but after reading into it, seems like not all victims were similar in intent (Some actually pushed tokens with write access to their account).

On a similar note, I did the same thing but for Google App Passwords which allow SMTP and IMAP access without 2FA a year ago (didn't write a blog about it) and saw some pretty disturbing things (e.g. cheaters). It's a pretty common issue that I'm surprised hasn't been fixed.
It's an ideal to strive for. Rarely reached. Yet things get better the closer we are to it, and worse the farther away.
Saw it stated somewhere “better than 90% of programmers.”

*DOUBT

Maybe at very constrained types of leetcode-esque problems for which it has ample training data.
Yes the whole goal with this is to extend the general notion of FaaS (Functions as a Service) into something that can work seamlessly, both within their own projects and across the Web. Similar to what Wikidata is already doing for common real-world entities and concepts. Of course, the devil is in the details with these kinds of things; it's likely that implementations of even the most basic functions will behave in subtly different ways across languages. Their testing framework is supposed to mitigate this but it looks quite ad-hoc.
> There's valuable learning (and empathy too) in having to see your own decisions and creations through their whole lifecycle.

This is so true. It's extremely enlightening to watch a design go from design docs to implementation and then finally the maintenance phase. A lot of problems that could happen never do and some unexpected ones pop up along the way.
> He did not buy Twitter to make money.

Is that what he told the banks when he was taking out the loan to buy Twitter?
already forgotten
interesting read. I was looking into this a while ago- company had a monorepo vs. polyrepo debate.
FYI what you're describing is https://en.wikipedia.org/wiki/Third-party_doctrine
>What will someone entering the workforce today even be doing in 2035?

The same thing they're doing now, just with tools that enable them to do some more of it. We've been having these discussions a dozen times, including pre- and post computerization and every time it ends up the same way. We went from entire teams writing Pokemon in Z80 assembly to someone cranking out games in Unity while barely knowing to code, and yet game devs still exist.
Researchers have discovered magnetic monopole quasi-particles
> so we will need to learn to read gzip

this rant gave me a proper laught. thank you.
I have one for guests. I grind my own beans and make cold brew concentrate for myself, but I’ve found that guests are typically more comfortable with the pods.
I have seen no assurance that the slope is well-gritted. There is a proven inverse correlation between corporate powers and consumer freedoms.

It's not fallacious in the slightest, you're simply enjoying the slide for now.
"just not in consumer equipment."

that's key isn't it? Ammonia is corrosive and consumers are often not too bright.
Multics stands for Multiplexed Information and Computer Services (not multi-user).

I don't think UNIX was ever meant to be single-user. This interview suggests that's not where the name came from anyway: https://www.linuxjournal.com/article/7035
I gather this might be changing per [1] as Wikifunctions is investigating the possibility of implementing interpreters such as CPython with WebAssembly.

[1] https://phabricator.wikimedia.org/T308250
Are you seriously suggesting that the most probable reason for not implementing a feature is bigotry? This is not Verge, this is HN. We're not journalists, we actually work in this industry.
The biggest advantage of Bard is the speed, it's practically instant.

I asked: How would I go about creating a sandbox directory for a subordinate user (namespaced user with subuid - e.g. uid 100000), that can be deleted as the superior user (e.g. uid 1000)? I want this to be done without root permissions.

Both said that it's impossible, which is the the generally accepted answer.

I then added: I don't care about data loss.

Bard correctly suggested mounting a filesystem (but didn't figure out that tmpfs would be the one to use). ChatGPT suggested using the sticky bit, which would make the situation worse.

Handing this one to Bard, especially given that it generated more detailed answers much faster.
One doesn’t exclude the other. Stop emitting carbon where it’s effective, and capture the rest. Unlike pollution, with co2 it’s ok to emit it as long as you capture it at the same time anywhere else on the planet.

And yes, in many places it is cheaper to just not emit, but in many other we may never get to that (heating in colder climates without nuclear, agriculture, air travel,
to some extent cement industry)
Good points about algorithm and auto play.

I'd add that if one has (permanent) control of the recommendation and auto playing then they're less like ads and more tools. Especially if they are opt in.
As a Vim user I agree. Spacemacs is an excellent Clojure dev environment.
I think you're responding to someone attempting to equate practicing psychologists with a 'public figure' giving general advice.
You might want to check out https://plan.cat
The facts don't bear this out. Various companies have already ported to AMD even though it isn't effortless.
That required 72,000 gallons of gasoline. Which was turned into 1.3 million pounds of CO2
I'm optimistic.

* Intel has a history of getting this type of software working.

* AMD doesn't.

I don't think I'll ever trust AMD after... experiences, but Intel I'm bullish on Intel.

Arc A770 seems like by far the bang for the buck once software lands. 16GB for $300 if you find a good deal. Decent performance. Stick four of them in a system, and you've got 64GB for $1200 and a pretty decent amount of compute. Buy five systems like that, and you can run the largest open-source LLMs out there with Alpa for ~$6K.

That brings Facebook's GPT3-grade OPT models from corporate down to serious enthusiast level.
Research shows mouse and primate brains mature at the same pace
Is it because of the .LGBT in the TLD?
Where do you get the 5x code idea from? Hip and cuda are almost regex-equivalent, openmp is the same language on each.
Google has shipped this in gboard, the Google keyboard - https://arxiv.org/pdf/1812.02903.pdf

(Disclaimer, I worked on a later version of this for other models in the android keyboard at Google)
"Narcotics" (opioids) are allowed outside of competition. So as long as you aren't taking damage during the 100m sprint, you're probably ok.
I liked t9 word and 9 key. Could type without looking.
Nobody owes him advertising $. If he wants to tell advertisers to go fuck themselves because they don't want to appear next to nazis that's his prerogative, but whining about how it's hurting his company is his problem.
More like: we've used technology to create such a mess that humans can't un-mess it. So... let's use AI to sort it out.

Doesn't make sense. If things get out of hand: stop making things worse, reflect & perhaps take a step back. Back to a state where things were manageable.

If eg. there's too many apps, then the fix is to organize them better. Or provide user-settable filters. Not throw in profit-focussed, shady opaque algorithms (or AI) to present user with what user is 'supposed' to like.
> 20 years from now, we're still going to want to run our own software

And you'll be able to, on hobby machines or VMs. But the general purpose machine where the owner controls the OS will fade.

Banks, popular sites and other choke points will demand attestation of an unmodified system for access. People will talk about internet access the way they do about driving in the US - a privilege, not a right.

Bet it.
I am researching that at this time as well. I have VNA etc and am keen to collaborate !

Charles@turnsys.com

I have quite a collection of research material on RF cages / testing .
Google has one major disadvantage - it's an old megacorporation, not a startup. OpenAI will be able to innovate faster. The best people want to work at OpenAI, not Google.
No I think I just tested it while his server was intermittently failing and it happened to correspond to switching this setting off and on.
This is really cool, and I expect groups like Eleuther will want to integrate it into their workflows.

That said, there is a fundamental rule here -- gradients must, at some point, be shared. This paper says they don't have to be shared every step. Which is really great. But, gradient sizes are on the order of magnitude of the network being trained.

To get this useful for indie LLM training, I'd guess that you'll want it to work sharing gradients not more often than once every few hours to day -- more than that, and bandwidth costs sending 50GB weights files around during training are going to kill you.

The paper seems to indicate they can share every few thousand? (8 workers x 500 times bandwidth reduction?) steps, but sharing every few millions would help that distributed large LLM use case, and my guess is that this is going to be a bit harder to get to converge. But hopefully not!

Related: there's an n^2 problem for getting the gradients out to lots of distributed compute resources.

So, if anyone wants to work on step 2, I'd suggest there's an engineering task: 1-N gradient upload and distribution, and then a science task: revalidating this with a few orders of magnitude less common checkins.
I think you're about the goal, but in practice it looks more line they are making code that is readable in 0 languages instead of at least 1 language.
It looks like in practice people are unsurprisingly coming up with workarounds for this by adding some boilerplate code, these are the first two lines from the python example above (also all the local variables in the function are in English too):

def Z10591(Z10591K1, Z10591K2):
word, is_ra_plural = Z10591K1, Z10591K2
I noticed the same thing, and it's relevant to the comparison results of Gemini vs ChatGPT that GPT 3.5 makes the exact same mistake, but GPT 4 correctly explains that the buoyancy is caused by the air inside the ducky.
The bing version of ChatGPT already does this. It might be specific to USA, but try asking it for a recommendation of a 1500w space heater for a small room. Every suggestion will have a link to an affiliate page that says [Ad] next to it.
I commuted 1.5 hours each way for a summer job once, it lasted just long enough to really internalize how awful it is. I don't understand how anybody does that for more than a few months who doesn't absolutely have to.
The article keeps saying "backhopping" but are they really talking about "bunnyhopping"?
I'm not sure it is.

You can do more with non-CUDA now than ever before.

At the same time, the number of things you can do only with CUDA is greater than ever before too.

The whole field it growing, and it's hard to compare.
They state why, albeit poorly worded and justified:

> we're working towards introducing new authentication solutions that complement traditional passwords

Anyway, terrible explanation on Google's part, IMHO.
> let the people decide whether want to buy a Tesla and support Elon.

Okay, let's let the people decide whether they want to buy heroin and support violent cartels.
Let's take the same approach to slavery. Or fire safety of buildings.

In fact, can you name 1 occasion in history when a consumer boycott stopped any kind of bad corporate behaviour - it does not even stop child slavery.
I used the isolation „fabric“ wrapped around the extension cable off a super cheap PCIe riser card. I put an iPhone inside which blocked WiFi, BT and 4G.
It's somewhat sad that AMD bet on open source over proprietary and then approximately zero people stepped up to help. Easier to use cuda and complain I suppose. Fortunately they've stuck with the open source plan anyway and just written it themselves.
Counterpoint, at scale a month of training a GPU cost more than an engineer now days.

And the large companies (Meta, Microsoft) buy these GPUs by the thousands upon thousands.

Having a small team of engineers spend a couple months porting code over is well worth it for even modest cost reductions.

These may not be useful to smaller companies working in the AI space, but odds are to sellout, all AMD really needs are the sales contracts that they've already announced.
I am not sure we are talking about the same project. However, the one I am thinking of had a interesting challenge where a security issue required making the default configuration requiring a allow-list for a certain long-existing feature. This ended up going out in a patch, even though it's a breaking change. I am still uncertain what the ideal solution would have been. Following SemVer 100% would required this to be a major. However, all supported versions needed this change. Forcing users from really old majors and minors to jump to a new major with all kinds of new stuff is less than ideal. The alternative would have been to ship multiple new majors that are really just upgrades to the old minor that they are patching. WHile technically correct, also crazy.
I don´t think so. There are few algorithms that cover the majority of use. For example in NLP a fast LLM (such as LLAMA) training/prediction and support for Hugging face transformers (BERT and such) would cover 95%+ of NLP use-cases that need a GPU.
No. https://wiki.sourceruns.org/wiki/Accelerated_Back_Hopping
haha, how timely for me to say "proprietary software is basically always a trap"! https://www.reuters.com/technology/cybersecurity/governments... (yeah, I know the same sort of thing can/does happen with FOSS stuff ;) )
Apologies, I should have read the rules. Thank you for correcting the post.
Love these but they have gotten very hard to find! https://unsharpen.com/pentel-wood-pencils/
Services across England now lag far behind East Germany
I would rather build with OpenAI products rather than with Google products because if I use a Google product, I know that it will shut down in two years tops.
I never liked rudy's bbq for any meal except breakfast. The bowls and burritos are pretty good, and a good value
> the fact that performing these ostensibly harmless customizations will introduce a security issue just leads me to believe an intelligence agency is involved somehow...

This is definitely the kind of thing intelligence agencies look for but considering the half century of C programmers utterly failing at decoding files safely makes me highly skeptical that anyone needed to compromise all of these vendors.

Also, the Hamas thing is a bit of a tangent but given that Israel had over a year’s advance notice I suspect that elite hacking is not a prerequisite.
> Are you paying for it?

I've been donating to the instance, yes. Although the reason this time is to do with UK's new laws on social media sites.
Yes, and one can bypass those write protections with physical access.

I'm going with what's written here as truth - if that's out of date, well... wouldn't surprise me, really: https://chromium.googlesource.com/chromiumos/docs/+/HEAD/wri...

> Note that even in case of the devices protected by the SE, opening up the device and disconnecting the battery would still disable write protection.

Unless I'm missing something, the "read only" region is simply a normally write-protected region of the flash chip, and with physical access, there a range of ways to rewrite that region.
Ah, in my worldview those steps are still in a single transaction. It's just formulated as several ordered statements.

Is that mechanism unique to PostgreSQL? Or is it just that this transaction is impractical for you, due to the wall clock duration and how it impacts other use of the DB?
This is awesome, and it seems extremely valuable to me for usage in performance sensitive code. With that said...

> Our system requires a lot of trial and error, and remains too costly to operate at scale.

It makes me think that we still need to find a method which is far more sample efficient. Generating (up to) 1 million samples for each problem introduces a lot of inefficiency here, and as the highest quality models start to require more and more resources, my guess is that we'll want to push in the direction of fewer samples with a smarter model (rather than the other way around).
Or Richmond, KY?
Of course I would stop multiple times, but it would improve the trip if I didn't have to stop in some of the obscure places where many EV chargers are located and instead stop at normal rest stops along the highway. That's supposed to be a short term issue as charging networks expand but truthfully there hasn't been very much movement in that regard.

Try to plan a trip from Atlanta, GA to Miami, FL. You aren't in a Tesla and your charging stops must always include a restroom. I think it might be legitimately impossible.

It's not like a gas car where you can just not plan anything at all and expect to find a place to stop to fuel your vehicle that has a restroom and convenience store all in the same place. You will instead expect to be in places that aren't really designed for short stops like Walmart/Costco/shopping mall parking lots. A 5 minute stop turns into a 20 minute charging stop plus a second stop to use the restroom or get hot foot.

The status quo is that you pay more for an EV and get a worse experience than the people who are paying less.
A shapeless version of something like this has been in my head for a very long time. I'm glad someone did the hard work of giving it a shape.
The 16 hasn't been released.
> However, the model can be reluctant to answer questions based on an individual sentence in a document, especially if that sentence has been injected or is out of place

>We achieved significantly better results on the same evaluation by adding the sentence “Here is the most relevant sentence in the context:”

It kind of feels like them telling us that we're using the model wrong and that by prompting the Assistant with the first part of the retrieval completion the model will outperform versus asking for single sentence retrieval.
a lot of "open source" companies leave their repos bare so you are forced to go onto their website where they can better track and retarget you
I used to, back when they were a thing: uucp, finger, gopher, talk, wall, rcp, nntp ;) etc. Not for over a couple decades now, though. I don't carry any particular nostalgia for any of them.

I did have to troubleshoot a WAIS[1] protocol issue this week, however. I am the only person in my company who's heard of WAIS, let alone directly used it. Nonetheless, a WAIS server somewhere started malfunctioning and library searches broke and it became a high priority thing.

1. https://en.wikipedia.org/wiki/Wide_area_information_server
Good grief, peach Nehi. Just the thought takes me back. I wonder if they still make that stuff?
Have you dropped the iPhone 14 Pro? Or 11 Pro?

These are literally stainless steel.

The 15s with their titanium is a step back.

The 11 Pro with its older curved edges has been the most solidly built phone ever IMO.
In addition, products that seem like magic at launch get worse over time instead of better.

I used to do all kinds of really cool routines and home control tasks with Google home, and it could hear and interpret my voice at a mumble. I used it as an alarm clock, to do list, calendar, grocery list, lighting control, give me weather updates, set times etc. It just worked.

Now I have to yell unnaturally loud for it to even wake, and even then the simplest commands have a 20% chance of throwing “Sorry I don’t understand” or playing random music. Despite having a device in every room it has lost the ability to detect proximity and will set timers or control devices across the house. I don’t trust it enough anymore for timers and alarms, since it will often confirm what I asked then simply… not do it.

Ask it to set a 10 minute timer.

It says ok setting a timer for 10 minutes.

3 mins later ask it how long is remaining on the timer. A couple years ago it would say “7 minutes”.

Now there’s a good chance it says I have no timers running.

It’s pathetic, and I would love any insight on the decay. (And yes they’re clean, the mics are as unobstructed as they were out of the box)
I think those pointing out the tech missed your point. It's fair to say that making paint is a technology but "painting" is an art and the two are very distinct.

An artist can create art with most anything, dirt and sand for example.

My wife has been painting lately. She has two sisters that paint as well and they're all remarkably good at it. So was her mother, and her mother's uncle was as well. He did a mural in the Ames, Iowa Post Office that was a WPA funded project that's pretty cool. Makes me wonder if there is a genetic connection :D

https://ameshistory.org/content/evolution-corn-post-office-m...
There were a bunch of presentations about matrix multiplication at the RISC-V summit last month. I'm not sure if any of the presented hardware is open source but maybe those videos are a good lead for tracking some down? https://www.youtube.com/playlist?list=PL85jopFZCnbMfMRR25ENc...
Not that I think that's why woz accepted citizenship, but it would allow him to move there in the event that tensions escalated to the point he thought it nessesary.
Hah, next step: Add a simple PLC the players can program to try to control it (or modbus to hook up an actual PLC) ;-)
Scientists Build Biological Robots from Human Cells
SpaceX's Tender Offer Values Startup at $175B or More
Bing Chat/Copilot already have ads and is free.
Rain is the one that most people (including Altman) are backing.
Can you share some examples in the Kubernetes space? I'm not as familiar with that area.
Ah, that makes sense. Is it possible for those researchers to just rent cloud compute, or is that also prohibited? I suppose that the obvious thought in my mind would be to find some cheap cloud GPU provider and use their platform to do the training. But maybe they're more concerned about inference afterwards, and so that doesn't really solve their issue.
While I do not know the details, I believe tapes are still the cheapest store per GB and it is likely S3 would be using a tape library in a DC.
Timing was definitely an issue - first Windows Phone came 3 years after iOS and 2 after Android. AFA the product itself, I think the perception it needed to overcome was more PocketPC/Windows Mobile having an incredibly substandard image in the market after the iOS release which seemed light years ahead, esp. since MS had that market to themselves for so many years.

That said, it got great reviews and they threw $$ at devs to develop for it, just couldn't gain traction. IME it was timing more than anything and by the time it came to market felt more reactionary than truly innovative.
US green card for a spouse to come over as an immigrant is also pretty easy, we didn't even need a lawyer for it, just one trip to Guangzhou.
Open source people would rather spend their time reverse engineering Nvidia, Mali, and Apple GPUs than helping AMD.