skysight-inc/HackerNews huggingface dataset:
I've written scrapers and web automation bots going as far back as 1998 (using VB5 and VB6 automating IE)

Nowadays mostly I write custom scrapers use PHP (Guzzle, Curl, etc) and Python (I was introduced to Beautiful Soup, by the "Python for Secret Agents" book)

I've tried several commercial scraper tools and services over the years but few stuck for various reasons.

UbotStudio had great potential but in the end was buggy and painful, almost abandonware.

Scrapinghub.com is decent enough but bit expensive for my projects.

80legs.com is cool for massive scale but was overly robots.txt restrictive at the time I tried using it (for what I was scraping) and I don't like the syntax.

A scraper colleague likes using Winautomation however it's no longer for sale separately, because Microsoft acquired the company and rolled it into their Power Automate SaaS (RPA/RDA focused)

There is a new tool called RTILA that I used for the very first time a 9 days ago, which actually is the easiest way to create and run scrapers I have found in 20 years.

The RTILA software currently has minimal documentation (apparently is being worked on now), however the new features are being developed fast, all releases are here on GitHub (see the frequency of releases)
https://github.com/IKAJIAN/rtila-releases/releases

Another user of the software has produced several video tutorials here showing how it works:
https://www.youtube.com/channel/UCH6ov8LnB8-4ZF0yraxjw8Q/vid...

You download it from GitHub but also still need to buy a license key from here
https://codecanyon.net/user/ikajian

The RTILA home page is here
https://rtila.ikajian.com/

I am a genuine customer and have no connection in any way with the solo founder developing it, (except for a few emails and support forum messages). Genuine recommendation for writing a bot more easily.
> whoever gets my mom queries gets her ad profile

This got me thinking —- are folks who can’t/won’t/rarely operate computers but are heavy users of voice control living in a post-ad world? Where would personalizes ads even be displayed? All the streaming services don’t have ads (at the right price point), and sure the buying products through voice devices could push particular brands, but amazon already does that with “amazon’s choice” products and I know many people who will only buy those, so nothing is really changing there. Similar for recommended content on streaming services.
Install and Run AWS CLI on Mac
When I was a boy my elders told me that we had to win the Cold War or we would end up with the government owning everything.
I'm pretty sure that there have been multiple attempts to recreate ggplot in python.

I can think of 3-4 off the top of my head.
Forgive me for straying OT:

It seems like a fact-based analogy. 'A group have been restrained to "territory", but a member has broken that restraint'. There doesn't seem inherently to be a judgement as to the restraint or the rogue being right/wrong.

I'd be interested in why you felt the usage was beyond the pale sufficiently that it needed to be reined in? The concept of territorial reservations doesn't appear to me to denigrate any group particularly; maybe I'm wrong in that?
It's kinda funny that this isn't widely appreciated. It used to be that research programs were most programs. Use of computers for other things was a kind of spin-off technology. (Now it's the other way around, of course.)
Well, there are patents for running diesel engines with sodium, at least I was told so much by my father who researched the problem thoroughly.
The density isn't that low considering using a fuel cell, you can convert the energy a lot more efficiently. Also you don't just burn up the fuel into the air as currently, there is no industrial process to collect the CO_2 and other gases produced from the exhaust.
Unfortunately self-driving cars also have to deal with nondeterministic humans.
Not really, but the way you put it sure sounds nice.
I wonder what the need for tools such as this or other "Kubernetes-by-example" type pages tell us about the complexity of configuring Kubernetes resources.

Do we need a better layer of abstraction, i.e. better adoption and tighter integration for something like kustomize? Have we fucked up completely with Kubernetes due to it being outrageously complicated for simple tasks? How we redesign this to be simpler? Is the complexity even a problem for the target audience?

I've no idea. I just know I'm a kubernetes admin and I can't write a deployment yaml without googling or copy/pasting.
> The calculations are not as simple as saying that people without children are just wasting societies resources when not at work.

Where did I say people without children are wasting societies resources?

I don't think everyone needs to have children. There are definitely some people cut out to raise children, and definitely some other people not cut out to raise children. (And loads of people in the middle.) Raising children is a massive amount of work and effort stress, and anyone who doesn't find that work rewarding is going to struggle to do a good job. The argument I made works both ways: a good parent will make society better, possibly for generations; a bad parent will make society worse, possibly for generations. If someone doesn't think parenting is for them, I'm the last person to push them into doing it.

But what's a fact is that it's critical to society that somebody do that work. The least we can do is cut the people who are doing that work a little extra slack.

I'm not sure what more free time has to do with it. Even if everybody only worked 20 hours a week, people with children would still need concessions that people without children don't.
Passing the final checkpoint NIST PQC 3rd round begins
This is a deplorable view and I'm not surprised you made a whole new throwaway account seemingly for the purpose of making it.
yuuuup

it feels like the third page in the godaddy checkout flow where it's like 'maybe you need our wordpress, email, and VPS hosting in order to launch your website'

also feels like a data grab. traditional exchanges don't collect this stuff, and the SEC doesn't collect most of it.
The big problem is once google killed it no new information will come and google can't scrape what doesn't exist
There are a lot of useful comments already.

Something that hasn't been pointed out yet as far as I can tell is that there are accessibility and quality errors on your website. If I am looking to hire somebody it's one of the things I look at when I want to see if they know what they are doing. Not everybody is like me, but these problems are worth fixing anyway:

- The "Explore" button is a span with a click handler, the click handler updates the URL hash. It's not keyboard focusable, and since it's just a link to a different location in the page, it could just be a link, but if it must be JS, it needs to be a button element.

- The form does not have accessible labels. Placeholder text is not a label. Also "fullname" looks like an error.

Lighthouse reports some other low hanging fruit.

Overall vibe of that website is that somebody chose some readily-available bootstrap landing page template and didn't check it for basic errors. That combined with the scant information about the company & the fact that your website is really just a single page does not inspire confidence. Even in the small amount of copy that is on the site, there are three errors in this one sentence:

"Healthcare providers will need an infracstructure what is open, interoperable and standards-compliant, which ensures the security, confidentiality and privacy of presonal data."

If you are not spellchecking your copy & shipping valid HTML for a single web page you make for yourselves, it would be wrong of me to expect higher quality in something you are hired to build. FHIR and HIPAA are tough and I have a ton of respect for you for being able to work in that context. The quality of your website should reflect the high standard you bring to that work.
I'm not certain, but I think you just described a REIT.
Seems like a lot of interesting sites recognise that I am scraping and block access with a capture. I've no idea how to get around that.
> but it's a genuine Canon lens

How do you know this? More to the point, how does an amateur buying their first lens ever know this?

My friends and I used to buy surprisingly good deal products on Craigslist and see how long it took to determine if they were fakes or broken. It was always one or the other.
Interesting! I went the other way. For whatever it's worth, I found lots of things in Vuetify that weren't documented, and overall found things less polished and complete.
Funny to see this on hn, I worked at a canoeing camp in Lake of the woods, and as such have spent a good amount of time in the northwest angle. I've even sung a rendition of proud Mary in the northern most bar of the contiguous US.
Give free presentations (webinars), youtube videos, show your work, demos, working products. Meet people in the health industry. Try to reach them and show what can you do. Ask for intros, show what you can do.
Not sure I parse that correctly, but is that supposed to mean there are no brain differences between people of different race or gender?
> _translations = {

> r'covid|cases|pandemic|virus|coronavirus': 'sickness',

> r'trump': 'dictator'

>}
> Netanyahu

for delaying any meaningful chance to solve the conflict with the Palestinians ? (ex-Israeli here)
Ah yes, the good old:

"Complains about pollusion, but still breathes the air"
A few years ago, I made the mistake of installing the utility software that came with my new Razor keyboard - I thought it was some special driver thing - and I had to make a new account and sign in? It's a keyboard.
I disagree with you categorizing it at 50% - seems like an arbitrary number that is unrealistically high in addition how do you measure productivity? Time at the desk? As well a lot of non children workers are also equally not as productive so I think you have a straw man argument going on here.

Finally, you miss the truth to the matter. If you are getting paid in equity you want the whole boat to float so short term mindsets such as working less for a couple months vs keeping the whole ship floating as a whole is more important. Imagine all the companies with parents just burned out right now - that's the difference.
Engineered 'nanobodies' block SARS-CoV-2 from infecting human cells
The Powder Toy came out about 3 years after The Powder Game and there was "The Falling Sand Game" considered to have kicked off the genre to popularity (video: https://external-preview.redd.it/KbiveNFl8yr3yJ0znWqoZM-7sIa...) which came out about 2 years prior to either (~2005).

Of course nothing is ever fully original and you can continue to trace back to an older "classic" if you like.
I love this. I grew up using this and still have the software on floppies, I may try this out.
Twitter still not accepting new accounts for verification
Yeah, I have to say I'm actually pretty impressed with the "rail up a hill" thing. Sure, 50MW isn't a ton, but it takes up nearly no space, infrastructure is very simple (5 miles of plain electrified track and that's it!), doesn't even need a crazy grade (7%), and most importantly: locomotives are cheap. IIRC, less than a million bucks for a good DC electric one, used. So you can be up and running pretty cheap and simple.

I'd love to see people running more of these setups. Especially in places where DC locomotives are cheap (former CIS countries), this could be even more cost effective.
Language is kind of the way we have serialized our thoughts for communication and storage. CLI is probably the simplest way to implement that in a computer, but you could probably go quite far by providing a TTS/STT interface to a CLI.

I'm not saying that's what you should do with Minecraft, but it could be interesting to see how such an interface is usable.
The proportion being ~100%? Then they can move on and suck some other company dry.
I suspect he's self-censoring his real opinion to avoid cancel culture. He basically gave a non-answer.
Yoga for Weight Loss
/* XPM */
static char * treachery_xpm[] = {
"10 10 1 1",
" c #0000FF",
" ",
" ",
" ",
" ",
" ",
" ",
" ",
" ",
" ",
" "};

X Pixmap format. Save as treachery.xpm.
(Made using Gimp, because it was faster than writing by hand. Sorry. But I have generated large pixel files programmatically in the X Bitmap format, which is similar but only one bit color information. Easier than writing a GIF.)
Nostalgia: Reveal Codes!
React vs. Ember – A Profound Comparison Between JavaScript Frameworks
Yep.. and if a privacy-positive company (say, apple) were to create a voice calling device (Facebook portal, echo show), I’d buy it for the grandparents in a heartbeat. The current system involves a nearby grandchild driving an hour there and back every time we want to have a family video chat to get their computers back into the state we told them to never modify.
And the last sentence indicates the author explicitly reached out to Amazon for comments.
The Powder Toy is solid fun. We've been portablizing it at PortableApps.com since 2012: https://portableapps.com/apps/games/powder-toy-portable
On the other hand, short-term shareholders, inasmuch as they prefer returned capital, are then freed to invest in other businesses.

If PayPal et al. had retained profits in the business for a long term goal, a substantial number of innovate companies couldn't have formed.

The more nuanced problem is likely that short-term and long-term shareholders' goals are mutually exclusive. That is, there is a rarely a strategy that's optimal for both.

Coupled with the fact that some businesses (apps!) favor short-term strategies, while others (biotech!) favor long-term strategies.
Having written a few scrapers, including the browser kind. I found the trick was to specialize.

Each website respond differently, some can just use requests, others would need selenium with pre-existing profile. To develop a common utility is almost futile.

I do have useful building blocks, but for each individual things I want to scrape I scale out using project specific code. It's never too slow either - the time it would take to fill in all of the required bits in a do it all tool would have been similar.
Yes; how high a fully charged battery could lift itself. I guess it’s similar to counting rocket fuel in seconds (lb_force-seconds per lb_weight).
The homes around here (suburb) fly off the shelves even if prices are higher then the last bubble (~2007)... not sure what is going on. Could people be moving away from large cities because of covid-19 and remote work opportunities?
Completely agree, and bought out all underwater mortages?! See HAMP program failure
Squeak-on-a-cellphone update: touchscreen working
Having had some exposure to the healthcare interop niche before -- this whole response is great.

Came here to say #1, which is articulated well here. Basically, who are you and why should I trust you -- the info I need in order to assess that would include at minimum your experience (detailed, like you worked with X tech on Y problem with Z firm, not high level fluff) but could also include your background (experience working at $EMR, managed $TECH at $HOSPITAL, studied or taught healthcare tech at $SCHOOL).

I'm sort of looking for your resume. The fact that it's NOT here makes me think it's not all that impressive (sorry to be so negative).
I like APIs better, but people gate their API behind paywalls.
How are you doing it? Automating an actual browser using the developer tools is probably the most under-the-radar way, and also quite nice to work with.

See: https://github.com/jawj/web-scraping-for-researchers
No, this won't work if the user is checking the attestation ability of the firmware or system. A similar exploit already exists by just modifying the firmware and expecting the user the just replace the CPU without checking the BIOS.
Danish inventor admits killing Swedish reporter in his homemade submarine
Great read, thank you for taking the time to write it and share it.
PostgreSQL extension providing SQL functions to query node OS metrics
> If the CPU doesn't perform as advertised you can always return it.

For second-hand CPUs? Not likely.
“ Common people should have non emergency sources of welfare, and governmental aid to rely on. If they don't, then the situation is aleady dire.”

The pandemic is showing that most people and state governments are willfully unprepared to provide such welfare even in an emergency.
Facebook doesn't plan to take strong action against anti-vaccination posts
Since 2-3 years, I saw a dramatic deterioration of search.
Whenever I am looking for anything that is not very mainstream, I get pages and pages of irrelevant results / SEO hacking sites
I just mean for load balancing a city running on wind and solar to optimize their costs.
But it means a group of volunteers (which fortunately exists, I depend on them for my phones) needs to keep tracking and duplicating an ever expanding component of Android, without have any say in the direction of its development. It's getting to be more Wine than Windows at this point.

It's problematic at minimum.
> This is the kind of behavior that will reduce our dispersed camping opportunities...More damage will lead to more closures by land-management agencies, and rightly so.

What would banning people from these areas achieve? Sure, you'd have an unspoilt wilderness, but...for whom?

The easily accessible areas are a tiny part of America's public land. Litter and vandalism don't significantly damage the local ecology in somewhere you already have hundreds or thousands of people passing through even with a leave-no-trace policy: they mostly make it less attractive for other visitors.

I'm not arguing that people should vandalise or litter public areas, or that the likely practical response wouldn't be to close affected areas. Just challenging the assertion that this would be a useful thing for the likes of the BLM to do. One possibility is that by closing them to RVs you keep them available to walkers on day trips or camping in tents, who may cause less damage if only because they can carry less stuff.
Anything's possible, but in practice...
Well the federal reserve isn't part of the government, so hurray for us I guess.
As someone whose line of work is land titles and surveying, this is particularly interesting! Good find.
Given this account's pro-CCP comment history and exclusively commenting on China-specific topics (seriously, nothing else) in its 8 month history, this comment should be taken with a Honda Civic-sized grain of salt.
Regarding Raptor...

https://www.talospace.com/2020/08/power10-sounds-really-grea...

https://www.talospace.com/2020/07/condor-cancelled.html?m=1#...

Were there ever any updates to that rather pessimistic blog post?
The use and definition of the term is completely descriptive and accurate. You are projecting some normative and negativity towards good descriptive term.

To show how absurd this subjective projected pejorativity is, lets use it to 'second hand':

>The question is not "Does the term second hand market have a meaning?" the question posed was "Is the use of the term perpetuating an unhealthy view of commerce to advantage manufacturers?".

>There is nothing "second" about selling used products.
If the price of the house rises faster than inflation, it is a good investment. However, rising faster than inflation also means that they become proportionally less affordable over time. You cannot have both affordable housing and high returns from housing
How to tell an accreting boson star from a black hole
> It’s mostly a solo endeavor.

The team is more than just Evan.

[1] https://vuejs.org/v2/guide/team.html
Flying under false hexcodes would appear, by analogy, to be a legitimate ruse: https://en.wikipedia.org/wiki/Ruse_de_guerre#Legitimate_ruse...

On the flip side, the same section directly states that Little Green Men/вежливые люди are also a legitimate ruse, as long as they aren't engaged in combat.

Edit: The reply makes an excellent point. Time to find out what counts as "time of war" these days, as formal declarations seem to have gone out of style, at least in the US, in the mid-twentieth century.

(To the best of my knowledge, not only is Korea a frozen conflict, but also the Chinese Civil War.)

Edit2: my casual surfing has only turned up rules for how to behave once armed hostilities have started. Outside of that case (and assuming the US even considers itself covered by IHL these days), things seem to devolve to "δυνατὰ δὲ οἱ προύχοντες πράσσουσι καὶ οἱ ἀσθενεῖς ξυγχωροῦσιν".
The US was also 90% white at the time [1], so one shouldn't be surprised murals would be "predominantly white", even if it wasn't for segregation.

[1] https://en.wikipedia.org/wiki/Demographics_of_the_United_Sta...
Since the funds can only go to one party there is little opportunity for fraud. Likely you can only pay once at a turnstile (or station for that matter). Not sure how OMNY works but usually transport passes will not work unless you've checked-out before using it for another entry.

The pass is only an identifier, it contains no payment information (you could be using pre-paid, credit card, direct debit but that happens on the "server" end).
Sure, but it's still funny that right-wingers and the sitting President keep bringing him up and want to knock him down a peg. It's like they're still obsessed after a bad breakup.
Just throwing this out there... Why not a simple rule to require all shares to be held for at least 24 hours before selling? It would certainly change the game in every way imaginable.
Hummingbird's temperature can fall to 38°F at night to preserve energy
That's kind of a technicality, the vast majority of non-mic'd speakers don't have all the required hardware or software to save or transmit audio to anything.
Do those "checks and balances" really matter in the light of what we've learned over the last seven years (and even before that)? It doesn't seem like there's much of "minimization" going on from the three letter agencies.
When did HN start pulling in comment threads from reddit? ;)
On your point where you said "Supposedly Amazon has operated things like AWS at a loss for long periods of time"
I agree AWS hasn't been losing money for a long time.

https://www.businessinsider.com/amazon-earnings-aws-amazon-w...

https://www.forbes.com/sites/petercohan/2020/01/06/how-much-...

edit:Formatting
Management in many companies are just puppets installed for the purpose of keeping a person or group of persons in control. You'd be surprised at how many companies have management that has the decision making capabilities of a toddlers. And when I say toddler, I mean that in a literal sense. You can take an intelligent toddler and have them make day-to-day decisions that would be BETTER than middle-management.
Java : 1995 : 25 y/o.

RoR : 2004 : 16 y/o.

Scala : 2004 : 16 y/o.

Django : 2005 :15 y/o.

golang : 2009 : 11 y/o.

Rust : 2010 : 10 y/o.

Kotlin : 2011 : 9 y/o.

Typescript : 2012 : 8 y/o.

React : 2013 : 7 y/o.

Docker : 2013 : 7 y/o.

Vue : 2014 : 6 y/o.

Not even the majority of the tech you mentioned is 7 y/o or less. And you can't name a single piece of tech on that list that isn't actively developed today because they're all actively developed, including Java, the tech that's been around for 25 years.

This is specifically why people talk about fad driven development and make fun of younger people who have no sense of history.

7 years just isn't a lot of time, anyone who thinks it is is a junior who thinks they're a senior.
The next version (now in beta) has a refreshed UI. There's a screenshot in this blog post:

https://k9mail.app/2020/06/01/Whats-Up-With-K-9-Mail
What I'm not sure I understand correctly is the second half of OP's content [how the change in downpayment requirement causes prices to rise such that a 5% downpayment is now the same as the prior 10% downpayment].
MongoDB’s Transformation (SaaS and Moving Downmarket)