skysight-inc/HackerNews huggingface dataset:
Make is often brought out for data, "single machine ETL" jobs, but for big, complicated (and iterative) workflows it doesn't feel good enough to me.

What do you folks use? Drake, "make for data" https://github.com/Factual/drake seems ok, but doesn't have "batch" jobs, (aka "pattern rules") where you can do every file in a directory matching a pattern.

Others have come up with different swiss army knives but nothing ever sticks for me, it usually ends up as a single Makefile with eg 3 targets that call a bunch of shell scripts.

The whole thing would be configurable to build from scratch, but not well set up to do incremental ETL on a per file basis, after I eg delete some extraneous rows in one file, clean up a column, redownload a folder, or add files to a dataset.
Interesting to see social media platforms finally starting to be (somewhat) more accountable to their users. Their motives are a dichotomy. On one hand, their revenue comes from advertisers, so they must be attractive in the "metrics," but by padding the metrics, they lose the users that those metrics are supposed to reflect. It seems that Twitter has finally reached an inflection point where having more engaged users is more important than just having "good numbers."

As social media matures, I'm sure we'll see where the advertiser-friendly vs user-friendly line is drawn. Reminiscent of the banner ad boom that initially made great revenue for the sites, but in the end netted negative for the sites because of the users it drove away.
Broadcom still ships new MIPS SOCs, like the BCM7231. Context: I work on set top boxes at Netflix.
I wouldn't bet on batteries, or at least conventional batteries, being the long term solution. There's interesting work being done with air pressure storage, flow batteries (the largest batteries currently under construction are mostly flow batteries in the 500MWh-1GWh range, though the technology is still in its infancy), and big scary vacuum flywheels.

All of these are far less developed than lithium ion cells, but have the potential to do a lot better on cost and longevity grounds.
Rather than turn this into a programming language flame war (lol), care to explain how an API only designed to run on a proprietary OS is not crap?
John De Goes: “Scala is receding on numerous observable measures”
As far as I know, the industry standard is the Lawrence Berkeley National Laboratory's annual 'Tracking The Sun' report[0]. I recommend it as a great primary source - the measurements are well explained and accompanied by helpful charts and analysis of the year-to-year changes. LBNL also publishes other useful resources on energy production/consumption, so it's worth browsing around to see what they have if you're interested.

[0]https://emp.lbl.gov/publications/tracking-sun-10-installed-p...
Hey, I can help with your home sickness.

It's brutal winter here for 8 months followed by a manic, hot four months of summer. No spring or fall. It takes two hours to get to anything that could reasonably be called nature. The people are great, but their main form of socializing is heavy drinking. It's cold? Let's drink about it. It's hot? Let's drink about it.

It's great, but no city is perfect.
Personal attacks aren't allowed on HN, even if someone else did it first. Please post civilly and substantively, or not at all. And for heaven's sake (or at least HN's), could you please just avoid flamewars?

https://news.ycombinator.com/newsguidelines.html
>Among the changes proposed by the senators and accepted by Mr. Pai was to require commenters to fill out a Captcha—a system designed to prove humans rather than bots provided the information.

Great, so instead of costing $0 to post 100,000 fake comments, it costs $200 ($2/1000 solves is the going rate on captcha farms)
Not only did YouTubeTV itself go down, but it won't let you log into Fox Sports to continue watching over there with an error during the authorization flow
Perhaps its this?

https://deq.utah.gov/air-quality/emission-credits-offset-reg...
How do you track it? What is it now?
I thought we established that the mechanism to secure your account was available the whole time, only users were too stupid to use it.
I think most people just want to have a good reason to buy a new Apple device and retire the old ones. I know I am. But personally I'm having a hard time finding one. My 2012 MBP is chugging along just fine albeit showing its age sometimes, also my iPad Air2, or the 2013 iMac.

I'm aware that some things have improved but you don't buy a CPU, or a screen, you buy a package. And for every improvement Apple also bundled in some sort of failure. Some in usability, some in reliability, and the overall value proposition is going down.
Once you discard type structure, it's a fruitless task to try to reconstruct it.

It's much easier to make sense of logs when we don't discard that type structure.

https://github.com/Morgan-Stanley/hobbes#storage
So we can give some responsibility to the low level people, which is all well and good - but then what? We’ve already started seeing some of these types of attacks against JavaScript engines too, so it’s a good guess that other languages are similarly vulnerable, as this isn’t a software bug.
“Women only” Google Event
It's in the article:

They also show that the efforts of the Trump administration to prop up fossil fuels at the expense of renewables aren’t enough to push solar out to sea. The tariffs that Trump levied earlier this year against cheap solar panels imported from China could eventually dampen installations. Naam said they add roughly 10 percent to the price of utility-scale projects, but “at most, they move the price of solar back by about a year.”

It's still a significant cost added on and slows things down, but you can only do so much damage.
doesn't that just push the "authority" to DNS. You still need someone to vouch that you are who you say you are.
>Actually it is hard. Most of your peers and yourself may be familiar with the quirks, but that doesn't mean it isn't hard. AWS's docs are terrible. Others being worse does't change that fact.

I think you've confused what "facts" are...

Doesn't matter. I guess some people are just destined to remain rack 'n stack sysadmins. Fine, more money and less competition for jobs then.

>As for rock solid colo docs- there is this thing called Google. And in fact you barely need that. It's real easy to set up.

I think you misunderstood my point. I know there are a thousand-and-one guides for setting up Nagios and Postfix and sticking HAProxy in front of it, but my point was that no amount of documentation can abstract away the actual pain points of dealing with co-los, including their owners, staff, and all the fun little problems that crop up with dealing with them.

For when it actually matters beyond a dollar value, I trust AWS engineers a lot more than I do HPE/Equinix etc...
I tried living in Chicago without a car… I wouldn’t say it is as optional as you suggest.
Indeed: https://en.wikipedia.org/wiki/Crescent_Dunes_Solar_Energy_Pr...
>All participants of Google events must abide by the following policy:

>1. Be excellent to each other. We want the event to be an excellent experience for everyone regardless of gender identity and expression, sexual orientation, disabilities, neurodiversity, physical appearance, body size, ethnicity, nationality, race, age, religion, or other protected category. Treat everyone with respect. Participate while acknowledging that everyone deserves to be here -- and each of us has the right to enjoy our experience without fear of harassment, discrimination, or condescension, whether blatant or via micro-aggressions. Jokes shouldn’t demean others. Consider what you are saying and how it would feel if it were said to or about you.

https://www.google.com/events/policy/anti-harassmentpolicy.h...
There are oh-so-many ways to address this and it's not clear what the market will pick.

First off, 100% solar is not likely to win out unless it's a small grid on an island. Any realistic grid will have wind and solar and hydro. New nuclear is already far more expensive than lithium ion batteries + solar, so that's out of contention for new builds unless a government is trying to subsidize the industries that are companions to fission power (nuclear submarines, etc.)

Among the ways to time shift electrical demand:

- lithium ion batteries. These will likely be only 5-6 cents/kWh within five years.

- thermal storage: cooling (making ice) or heat can be stored for these energy applications

- demand response: EVs and many other large demand sources can respond to price signals or aggregated demand response to shift their consumption to the best times. Currently this is mostly used to shave the peaks off of demand but with critical mass of EV there will be huge amounts of valley filling too.

- vehicle to grid: I'm somewhat skeptical this will win a cost battle, but it's being investigated: high penetrations of EVs mean that there will be a day or more of storage on wheels. This can be used in all sorts of ways, potentially.

- flow batteries: I'm also skeptical that these will win on price, but they might.

- concentrating solar power: this is solar power from heat, therma storage can be used in conjunction to deliver 24 hour power. Early pilots were super expensive but recent project have dropped drastically in price to the point where it has a chance of being competitive with other storage tech.

- lots of others that I'm forgetting.

Basically solar is will probably get so cheap that we'll overbuild a ton of it and have more power than the inverters can handle, and size the installs for the winter lows, most likely. This means that there will likely be tons of extra unused DC power at solar sites for large chunks of the year. Could be an opportunity...
Good. If you follow any remotely popular people you'll run in to bots. You can see bots spamming replies to people even with just 80,000 followers --less than the million mark.
That's fair, and I sympathize with that position.
BaSiX – A Basic interpreter written in TeX (1990) [pdf]
Given that solar auction minimum bids have dropped 470% in the last 4 years (in Mexico, https://earther.com/mexico-just-auctioned-off-the-cheapest-s...), isn't it crazy to accept a 25 year flat rate contract?
The goal is to show news headlines at their respective location on the map.
At the beginning only the most important headlines are shown. You can zoom in to a specific region of your interest to show additional news concerning that region.

Click on a location name to open a list with additional news from that location.

The geotagging of news articles is done with a software developed by myself, the language models still have a lot room for optimization. Therefore errors can sometimes occur and are never the fault of the source.

I appreciate any feedback, wether on design, usability or feature suggestions
the screenshot has go, java, c++, and nodeJS as choosable languages....
This doesn't answer the more important question. The issue isn't how do you handle "incorrect" information, it's how do you REMOVE information.

Basically, when someone doxxes someone, and dumps the result onto your system, how to you remove it?

If you don't have a facility for rendering intentionally malicious information impossible to access, your system is fundamentally broken.
"I was shocked how much casual racism is present there."

Don't move to California then as it's probably one of the most shockingly(it's California!) racist places I've ever lived. And I'm from Chicago!
I'll admit that some of the Bitwarden clients are... less reliable than I would like.
https://verusart.com. 3D printed. $1,400.— buys you a copy of a van Gogh (https://shop.verusart.com/collections/verus-art-national-gal...)
Please do not post generic ideological comments to HN. It leads to generic ideological flamewars, and those are off topic here.

https://news.ycombinator.com/newsguidelines.html
Depends upon what type of data you want.

If you want to check solar energy prices for your _home_, then I'd recommend EnergySage (https://www.energysage.com/). I think they have a tool for commercial buildings as well, but don't quote me.

If you want more generic public data, I think other commenters have better sources, though their blog might have some articles wit that information.
I own two parking spaces in a private garage on the edge of downtown - have one car and rent the other space. 5 years ago, I could rent it for $300 per month with a waiting list of people that want it. Today I am renting it for $200 per month and it would take a week or so to find a new tenant. In that time, my neighborhood has grown considerably and has become much more expensive.

Multiple car ownership (or ownership at all) just isn't that desirable any more and Chicago's relaxation of minimum parking requirements are very much market-driven. Parking costs a lot of money to build and takes up a lot of space in a building. Because there is nothing preventing a developer from building more parking than required, he or she has the freedom to match market demand.

There is a 50-floor, ~500-unit apartment building under construction in my neighborhood that, due to its proximity to a train station, was required to build exactly 0 parking spaces. The developer chose to build around 75.
I'm not saying it is the solution but the government already has systems which let you log in securely and verify identity, such as the IRS and SSA websites. Neither of them are much of a hassle to sign up for.

I think a slight inconvenience to signing up is better than having your comment drowned out in useless noise.
Your username suggests an option, but I shall hope you are focused on solar at the moment
>>To flag information as incorrect, you need to take tokens and challenge the data. A challenge starts a vote and anyone in the DIRT network can vote with their tokens on what information is correct. The vote winner and majority voters earn tokens. The vote loser and minority voters are penalized.

You're right this only works well for objective information or facts. Hence, any articles that hint of an opinion (i.e. pick any Wikipedia editing war topic) would result in a mono-culture dominated by those with the most tokens.

I'm really curious to see how this plays out. Best of luck.
> [...] --ftp-passwd="$(ILCAMPAIGNCASH_FTP_PASSWD)" ftp://ftp.elections.il.gov/[...]

Is that using traditional (plaintext) FTP? Is it listening on port 21?

~ $ ftp ftp.elections.il.gov
Connected to ftp.elections.il.gov (163.191.231.32).
220-Microsoft FTP Service
220 SBE
Name (ftp.elections.il.gov): ^C

It looks like they are sending their password in plaintext. aria2 supports SFTP, so they should really talk to elections.il.gov about moving to SFTP or any other protocol that doesn't send the password in plaintext.
Kudos to twitter on this. This is one of those moves that harms them in the eyes of short term investors, but is The Right Thing To Do.

I've always been astounded that nobody seems to notice that Facebook continually announces record users, record MAUs and then usually a week or two after their quarterly numbers announces that they have removing millions of fake accounts. Always after they've 'beaten' on those metrics.

Facebook these days, for me, is 90% dealing with fake friend requests from people that are either clones of real profiles, or just complete garbage. It's part of my dislike of their platform, but they're more afraid of bad metrics than genuinely delighting their customer base.

It becomes a negative feedback loop too. We used to spend significantly on Facebook for several businesses I'm involved in, but now that most clicks are garbage/fake, we don't.

I know twitter gets a bunch of hate for not doing more, but realistically they are actually leading the way. I'm impressed with how they're operating more and more.
Only if you assume that the relevant police are operating blindly at the request of the TSA officer. If they're doing their jobs... then they should themselves be checking that this event does in fact call for detainment.

It would be the same with mall security calling an actual police officer. Or you calling 911 on someone else. The officer should still be operating with autonomy, and can turn down your request to detain when its unnecessary or unreasonable (though I would imagine these psuedo-authorities are provided benefit of the doubt)
I may be cynical but when I read they want a new system to create 'safeguards against abusive conduct', I really think they mean they want a system to suppress the sudden influx of actual public opinions (similar to that of the rush of traffic Last Week Tonight referred during their segment on Net Neutrality) and not flood out the machine driven comments supporting their decisions.
That's what's generally happening. It's a bit of a limiting factor, though. As you have more and more renewable, you need more and more gas plants which mostly sit around doing nothing, which isn't free.

There's also the opposite problem, particularly in the case of wind turbines; if you have enough, then your base-load (ie coal, nuclear, hydro) plus renewable may sometimes exceed demand. This happens from time to time in Ireland, for instance, due to a large installed base of wind. At that point you have to turn off renewable, and that's not always trivial or instant. Storage would help there, too, by absorbing the excess.
...well, that was what I was trying to point out.
Water is already used for that: https://en.wikipedia.org/wiki/Pumped-storage_hydroelectricit...
I think a big part of it is a tendency of tech/engineering sorts to have an allergic reaction against any sort of tradition. Old fashioned is worse than uncool, it's dumb and outs you as an inferior mind to the engineering who is always rational and pragmatic and has no time for tradition.

In other words, it's a social disorder.
Tacoma has a bizarre direction pattern for its streets. Every location east of A Street is "East", and west of Division is "West". Between these 2 (and including A and Division streets), everything north of 6th Ave is "North" and south of 6th Ave is "South".

6th Ave itself has no direction name, and oddly, streets increment in both directions. North of 6th Ave is 7th Ave North, while south of 6th Ave is 7th Ave South. There is no 1st Ave through 5th Ave.

These directional names persist through Pierce County, so the vast majority of roads in the county have "East" appended to them, all the way out to Mt. Rainier (which is also in Pierce County). North of Tacoma's Narrows Bridge lay Gig Harbor and the Key Peninsula, where streets prepend the direction name with "KP" - i.e. "KPN" for North - to be more clear that they're across Puget Sound from the rest of Pierce County.

https://en.wikipedia.org/wiki/Tacoma,_Washington#Transportat...
Interesting top level domain choice. Twilio might come knocking
I know the reference but in this case I would consider "rehydrate" as the standard term for these kind of things.
Then maybe GP should say that instead of making false statements about ambulances for dramatic effect. Ambulances are for emergencies. Nobody has ever died because they couldn't afford an ambulance to take them to their chemotherapy appointment.
> But I would assume someone capable of paying market rates, typically still owns a car. That car still needs a parking space, so even if the owner does not use it for his daily commute, the presence of the car still has an impact.

I can't find the study, but there's actually some data to back up what you're saying regarding TODs -- people generally still cling to their cars despite living close to public transit.

But it's not necessarily a black-and-white issue. You have to look at actual miles driven to get a clear picture.

For example, I live in Chicago near a CTA Blue Line station and Metra Station. We've have gone weeks without using the car. We drive, maybe 2,500 miles/year, with a chunk of that visiting my father up in Wisconsin. But we'd never give it up since we have a kid and that just makes things easier.
FYI hobbies and dayjobs are not legally mandated to be correlated.
Asbestos is rock.
FYI, your SSL certificate is invalid
”It was surprisingly a very learnable dataset”

It also is a dataset where cheating is quite easy. A google search may quickly turn up items you left out of the training set.

Do you know whether any teams did this (could even have happened by accident, if people googled to find different views of paintings, and accidentally included pictures not in the training set)?
YouTube TV Is Down (Updated) – Droid Life
Which buildings are you thinking of? I'm aware of two that are under construction (the wavy building on the river near lakeshore east and the building at michigan and roosevelt), but I don't think either will be open by EOY.
That's sort of the dilemma I see - living in the US and make more money compared to EU friends, but the lifestyle component of US work life is much behind EU. I can see how working in the US to earn more money during younger years might be good, then moving to EU later in life to enjoy the social benefits. Even in Silicon Valley, there are many people I know who make 6-figure salaries, but spend 2+hrs per day commuting, live in small apartments since rent is so high, and basically spend any time not eating/sleeping at or around work.
Sorry! I really hadn't intended it as flamebait, just a mild quip over the absolute futility of the situation. I honestly thought it would fit in with the HN consensus regarding the TSA.
I'd rather work not be compulsory. I actually do like people.

I despise power differential, brown nosing, ass kissing sucophants, pretending to care about things I have no natural interest in, and condescending tough guys.
If you continue to break the site guidelines we are going to have to ban you. Please fix this by posting civilly and substantively, or not at all.

https://news.ycombinator.com/item?id=17504893

https://news.ycombinator.com/newsguidelines.html
I don't know if this is overly pendantic, but surely they mean prices dropped by 79%? Percentages in the hundreds would mean prices deep in the negatives.
Yup, that's what I thought as well. It's a nice OSS package though.
Currently, typically, you ramp up gas production. This is obviously still better than using the gas throughout the day and night. In the future, improvements in storage technology may make that more viable; there are already experiments in this direction, with 1GWh-scale flow battery storage facilities to be completed in Germany and China in the next year.

Power usage is typically lower at night, of course. And wind generation tends to be a bit higher at night in most places.
Instagram is a space where influencers were deeply affected by a purging of bot accounts (although I can't remember the year this occurred). People made posts in droves complaining to Instagram, asking for them back, and in one case a user cried that "those were users I will never get back".
New low cost investment app launched in South Africa
The article specifically mentions Boston, San Francisco, Washington and New York as other skyscraper cities. I think their "definition" of skyscraper city is a more about density than just the number of 40+ story buildings.

I think possibly the only legit "skyscraper city" that has been left out according to the article's "definition" would be Philadelphia which is affordable still.
After college, I actually moved from the Chicago suburbs into the city in part because I don't like driving and didn't want to get a car. It's worked pretty well.
Waiting for economic factors to suppress the birth rate is the milquetoast approach I described earlier in this thread that is causing incredible environmental destruction. It's nothing more than an excuse to turn a blind eye to the problem.
You still get wind power at night in most areas. You can also ramp up natural gas plants at night to pick up demand. You can store energy as well using pumped hydro or batteries. We are not yet in a situation where large-scale storage is totally necessary though. The grid managers are able to make everything work using the flexible resources already on the grid today.