skysight-inc/HackerNews huggingface dataset:
Doing an API-first approach - which I recommend -

a) involves an incredible amount of DRY in the specs (to the extend we tinkered with a DSL to generate the openapi which feels wrong)
b) doesn't have very good ways of splitting large files up and
c) is YAML which is horrible. (Yes, JSON too, but that's even worse for authoring).

I can see if you're trying to describe an existing API with OpenAPI there are enhancements here which you will welcome.

If you're using OpenAPI to develop new APIs, I've come to the conclusion of "don't. Use GraphQL". After initially worrying about over-fetching and N+1 stuff, and thinking "yeah GraphQL for the front end, but the serious stuff should be OpenAPI" I've ditched that. GQL Federation was the final nail; it /does/ force some conversations up the chain (how exactly ought two, supposedly completely independent APIs, federate) but in practice this is a useful attribute.
Poland is also an EU country and lots of subsidies come round to complying with them, and reaching Solar goals is part of them. Even when the government doesn’t cooperates, they still accept all the money/work they can get.

Not only that, but also lots of other infrastructure.
1008 numbered Pokémon as of the latest game (excluding the forthcoming DLC), although the true count is possibly implementation dependent - at the very least some Pokémon have different 'forms' which can have different stats, and so will be stronger/faster/healthier.

The world of Pokémon can be crazily complicated if you let it ;-).
This seems to paint a picture of a bright future in which humanity will enjoy the benefits of cheap energy. If solar energy can replace oil, will the pattern of the world change as a result? If the world changes as a result, what impact will this change have?
AI Hype and the Disciplining of “Creative,” Academic, and Journalistic Labor
Alceris Analytics: Lightweight, privacy focused Google Analytics alternative
Yes, hydro's great. The problem is scaling; "that plant is super helpful, let's build ten more nearby" isn't possible like it is with other forms of power generation.
Ask HN: Lots of AWS credits expiring soon, ideas?
Hey HN,

Long story short I have a lot (~$10K) of AWS credits expiring in a few months. Any ideas on the best way to make money / do some good with those? I can't directly sell them. Thanks!
> mass shootings happen because ...

Unfortunately with regard to that point, you are naively mistaken, mass shootings happen because we as a people enforce gun-free zones and these extreme and malign individuals target those zones for the highest possible casualty count. Some of those shooters who were caught alive have admitted this.

When you have gun-free zones you have an area the shooter knows people will have no means of shooting back. There is plenty of propaganda to the contrary, but that is all it is; propaganda.

When was the last time you heard in the media all the times someone tried to do a mass shooting but died because someone nearby with a gun stopped them after the first person was shot. It rarely merits coverage.

The news doesn't even merit coverage most times aside from local coverage, but when a lot of people die its national, and pushing a gun control narrative.

Why don't they want people to have guns?

People with guns don't give up their liberty when tyrants and fascists try to tell them otherwise and take it, that is a core part of our American History.

Also we have a right to own and bear firearms that's written into the constitution. Do I need to tell you what upholding and enforcing laws that have no legal authority basis engenders for the system as a whole? It certainly would not be a democracy which follows the rule of law.

There are ways to get it done so it would comply with the rule of law, if people truly wanted that, but it requires constitutional amendments which frankly haven't happened and won't happen so long as there exists an educated and knowledgeable population that values their history.

FWIW, I think you need to learn more about your history and how to recognize propaganda to correct those deficiencies, otherwise you are just adding to harmful noise in a very Unamerican way.
It's gotten a more efficient over the years. Also, built-in GPUs are not that slow anymore. Lag can also be caused by desktop environment animations which you can just speed up or disable.
The curl website now features text alerting about NVD “abuse”
"Alert: if you look up curl CVEs in public sources like NVD you will find they use inflated severity levels and CVSS scores. They think they know better and override our assessments. This is a systemic error that we unfortunately cannot fix. Feel free to complain to them - we keep doing it to no use - and consider using our material as the canonical sources for curl issues."
https://github.com/mozilla/sccache is another option which addresses the use cases of both icecream and ccache (and also supports Rust, and cloud storage of artifacts, if those are useful for you)
That might be true on the surface. But there needs to be an explanation why all that printing had no side effects. It doesn't make sense. Something else must be going on.
> today we seem too willing to put up with being sold broken stuff.

i remember reading that when hard disks just came into the mass market they were so expensive that having some bad sectors was not such a big deal... and so hard disk would usually come with a sheet of paper listing the known broken sectors (detected at QA stage, i guess).

maybe someone older than me (i guess somebody in their 50ies or 60ies) could confirm that.
That was very interest.
The life of self driving cars was nothing but great exaggeration.

Couple years ago, people here would tell you but of course Tesla is worth 10x Toyota, because of their "self driving" lead. That the entire economy was changing and children wouldn't need to learn to drive anymore.

Then, and now: the truth is that autonomous vehicles have some niche usefulness, but are not a general replacement for human guidance yet, and don't look to be for at least another long while. decade range. But that's not what the hype is selling so no one wants to hear it.
I heard about Xlinks before and I'm cheering for it, but to me a shorter, but more powerful HVDC line to Spain and a plant there would yield better returns, and earlier at that.

Solar is booming there anyway - there's currently 22GW connected to the grid, which is double that of the 2019 figure. A far cry from the days of the infamous sun tax.

The world relies on Morocco for its minerals used in fertilizers so if it were not a safe place to invest, we would have worse problems to deal with, but still, the world record in HVDC line length might be not worth it.
The Polish holocaust debate is rather interesting, because Polish people (as in, ethnic Poles) were both victims and perpetrators; millions of Polish were killed during the holocaust, and the plan was to kill up to ~85% of them and use the rest in forced labour (i.e. slavery, basically) to make lebensraum for more worthy people. Slavs weren't considered as bad as Jews, but still untermenschen.

At the time same, it's obviously true that some Polish people were also perpetrators.

It's interesting to watch the debate; it's not just far-right extremism or fascism that opposes the more nuanced view. There are a lot of emotions involved and it raises interesting questions about what it means to "be Polish", to "be a victim", group identity, shared national identity, etc.
PostGIS is really really cool. I got a small look at it setting it up as a QGis backend and doing more with it is on my list. It feels a bit under-appreciated.

Postgres extensions also seem like a bit of a secret weapon.
You are probably aware, but for. others with ccache this is called "cache sloppiness", which is my favourite term.

You can set this via config, as by default ccache is paranoid about being correct. But you can tweak it with things like setting a build directory home (this is great for me, as I'm the only user but compile things in say `/home/josh/dev/foo` and `/home/josh/dev/bar` and have my build directory as my dev directory and it's shared. (see https://ccache.dev/manual/latest.html for all the wonderful knobs you can turn and tweak).

Fantastic tool, the compression with zstd is fantastic as well.

I played with distcc (as I have a "homelab" with a couple of higher end consumer desktops), but found it not worth my time as compiling locally was faster. I'm sure with much bigger code bases (like yours) this would be great. Reason I used it it that archlinux makes it super easy to use with makepkg (their build tool script that helps to build packages).
Sure, but the interim solution of "just deploy more panels and turn down/off the existing fossil fuel plants during the day" is working pretty well. I suppose once we start seeing significant periods of negative or zero pricing the storage will start happening.
I have a suggestion for improving clarity:

word_bag: dict[str, int] = dict() # Multiset

for line in raw_corpus:
words = line.split()

for word in words:
if word in word_bag:
word_bag[word] += 1
else:
word_bag[word] = 1

Try:

word_bag = collections.Counter()
for line in raw_corpus:
word_bag.update(line.split())

then, to filter:

word_bag = {word: count for (word, count) in word_bag.items()
if count >= min_frequency}

or, if you can avoid printing the filtered word bag:

return set(word for (word, count) in word_bag.items()
if count >= min_frequency)

Also, that:

raw_corpus : list[list[str]],

should be list[str]. It's your corpus which is a list[list[str]]. (And you might want to use "line_words" instead of "line"

Could you explain why lines are processed independently?

for i, line in enumerate(corpus):
for j, target_word in enumerate(line):

Does it make a difference that some lines have fewer words than others?

I would think that

for positive_words in sliding_window(flatten(corpus), window_size):

using the sliding_window and flatting recipes at https://docs.python.org/3/library/itertools.html#itertools-r... would be more appropriate. Though using it directly would not handle the leading/trailing partial windows.

I liked seeing the 'η' - I haven't yet used non-ASCII in my code!
In Western Massachusetts I have an all electric building heated with air sourced heat pumps.

December through March is when I buy electricity. I now have documented how KWhs or BTUs I need to eliminate the massive heating load. Last August the Governor made a new deal for better pricing of the electricity I deliver to the grid. This year I will see a much higher income for my excess summer production. I will re-invest this into more production.

The real problem with solar is only a few months of the year. Isolating the problem of energy production and storage to only those months demonstrates how close we are to a new energy future. My next step will be solar thermal install. I want a more passive method for heating as a backup.

My location 42.73226° N, 73.19623° W. I can provide five years of production data if people are curious.
Apart from solar being cheaper people don't consider the fact that electricity itself will also keep getting cheaper as price for solar keeps falling. It is going to change the world dramatically as the world electrifies because of it. As cost of production as well as the running cost for a lot of stuff will start dropping yearly. We are still few years from that point though as worlds yearly electricity usage growth has yet to be eclipsed by solar and wind annual capacity installations.
At completely different scales than providing an entire country's energy needs through two cables. The UK currently has more than 2000 power stations providing balanced electricity throughout the country. The international transport is also for balancing, not for providing an entire country's energy needs from another country.

You can't just connect 20 cable's from Africa to the European grid and expect it to work, that's not how the grid works. And I'm truly surprised that many people on HN seem to think it would.

Source: I work in utilities and one of my current focus area's is creating software to help expand the net to cope with the addition of new renewable sources and EV charging stations. And even that is posing a massive challenge on a relatively small and local scale. I couldn't imagine the impact of this fantasy of just plugging in some cables from Africa somewhere.

Edit: This incident is an example of how sensitive all this stuff is:

https://www.bloomberg.com/news/articles/2021-01-27/green-shi...
Hint for applying ideas from comments: read information and understand the main point behind it, consider how it applies to your situation, then if it's beneficial try to implement it in a way relevant to you.

If you take comments like mine and try to implement them literally, that's stupid and it's on you.
Okay so funny story: I once worked with a company with insane security rules. 2FA every time you log into any program on your computer. I had to get fingerprinted to get a company laptop. No installation privileges. it goes on and on. And I was just a consultant with no access to code or anything, this is just to be able to attend meetings and see google docs.

Chrome extensions? No limitations at all, not even checked, add whatever you want.

I thought that was pretty funny.
Most new solar is unsubsidized.
After you make changes, if you like them, you can commit them.
> That makes no sense. The copyright holder has access to their own inventions, of course.

No, not talking about the copyright holder, I'm talking about the hypothetical individual(s) creating infringing copies. If those people need to already have a copy of the image to extract a copy of the image from the generative image model, then I'm saying the argument that the model itself is infringing seems weak. Or it's at least not an open-and-shut case.

>> A sufficiently advanced model could, in theory, generate any image. You could then, again in theory, find an embedding for any image. Does said model then infringe on all copyrighted images?

> Without the slightest doubt.

I'll continue to argue otherwise. This proposed model is not a compressed archive that reproduces a set of infringing works when decompressed. Instead, you already have to have a copy of an image to find an embedding. Otherwise, the chances of the model spitting out copies of infringing works is exceedingly improbable. (A program that outputs random noise also has a vastly improbable chance of spitting out a copyrighted work, but that's hardly keeping copyright holders up a night.) Furthermore, in being able to produce any image, the model is not going to contain every image, and provided a copyrighted image produced after the creation of the model, you could still find an embedding. From a copyright perspective, suing the creator of this model would be like suing someone over distributing an image of random noise, claiming that because you can find an "embedding" which produces your copyrighted work (really just the difference between the two images), the noise is infringing.

Now, if you want to sue someone for distributing an embedding into this model for infringement, that's another matter entirely. That makes perfect sense.

In reality, I acknowledge that models like Stable Diffusion are going to be a bit more muddy. There definitely is some overfitting going on, so some images are literally present. However, it's a case-by-case thing. Given the requirements (framed as an "attack" no less) for extracting those images, a particular release of SD might or might not be found to infringe. Other models, with better training and better datasets, could avoid the overfitting problem.

> The method of storing the information is pretty much irrelevant to copyright. Your link argument has been tried by pirates and it's not working too well, although it depends on the country and legislation.

Unless you agree that Pi itself is a copyright violation, I think you misunderstand. I'm not making the same "link" argument made by pirates. The index and length needed to find copyrighted embeddings in Pi is just a different encoding for the same data, similar to a compressed version of the same data, though I'm sure the Pi embedding would in fact tend to be absurdly larger than the original. Again, I'm saying that Pi isn't infringing here, but the Pi-rates with their "links" would be where the infringement happens.
nice username, can i ask you what did you see?
Stable Diffusion is obsessed with Rick Astley
When developing a subprompt weight implementation for AI Horde, I discovered that Stable Diffusion is kinda obsessed with Rick Astley.

If you increase the magnitude of the conditioning vector enough, the model will start producing this single frame from the 'Never Gonna Give You Up' video, regardless of prompt or seed.
I think if I did webdev full time, the price would be easily justified.

OP: Consider hobbyists and generalist who aren’t full time. There might be a market segment for short term access for hobbyists or generalists.

I would be easily willing to pay $2/day to have this while redoing my personal website, but $30 seems steep for a short term use. Doing a daily price could work to bring in users by serving as a low-cost demo.
It means anyone launching amd powered virtual machines on cloud providers can experience this now, at any point, and you don't know when it will happen, given this type of CPU could have been bought, booted or rebooted anytime in the past three years.

Seems comparably problematic to me.
How many examples will you need before you say "oh ok, I can see some valid concerns."?

I've worked in places where expensive Lab equipment is running off outdated PCs/servers because updates aren't available and they will absolutely stay on for as long as possible.

We're not all silicon valley, things can be expensive and difficult to replace...
Re: snaking down the highways—I'm not an electrician, but my understanding is that transporting electricity over distance is costly. First, because you have to run and long-term maintain additional wire, which isn't free, but second because of something called "transmission and distribution losses"—essentially, some fraction of the power you generated gets lost whenever you send it along a wire. That's why the existing grid uses high voltage for transport and transformers to step it back down where it's going to be used.

Solar panels are getting better and better all the time, but for a long time the marginal benefits of running them have been slim (once you offset the power generation by the cost to manufacture, install, and maintain them). And their output is notoriously unpredictable because it's dependent on weather. So, T&D losses alone are enough of a factor to make certain kinds of solar deployment unfeasible. Then consider how much easier maintenance would be if your panels are arranged in a conventional solar farm rather than running for miles down a highway. So, rather than snaking along highways, it's probably better to cluster all the panels close together just outside (or, as you also suggest, integrated into) a major population center.
Not so much outside a couple of G20 like countries, Windows and GNU/Linux win out.

Then there are all the electronic devices that have CPUs on them and don't run any kind of Apple related software.
People involved in covering up health dangers should be personally responsible for their criminal actions and prosecuted the hard way.
Ask HN: Are you afraid of providing LLMs with knowledge?
When I was young some of my peers considered me a very creative person, perhaps, fortunately, not any more. I think I have been a great part of my life searching for knowledge, just for the pleasure of it. I would not like that the latent knowledge encoded in my mind was transfered to a LLM, or to give any hint for improvement of closed LLMs. Perhaps there are many people that think like me, I don't know how we could unite our knowledge and avoid that the LLM take our ideas.

Edite: The lust of knowledge is a mortal sin, so I doubt I will be able to stop searching for ways of creating intelligent agents for solving problems, so I wish there would be a shield to prevent revealing any new idea in case it emerges.
Especially compared to something like this: https://www.theregister.com/2020/04/02/boeing_787_power_cycl...