Site rip of chip.tomsk.ru SMD codes catalog - Page 1
Forum section: electronics / projects

author: hanakp
author_rank: Regular Contributor
timestamp: October 09, 2022, 09:05:05 am
content: Short version:I made scripts to copy this SMD code site from the Internet Archive. The SMD tables are mostly complete, but the links to "datasheets" don't work. I'm attaching the copy (and the scripts) in two parts here to circumvent the file size limits. Enjoy!Long version:I really liked chip.tomsk.ru, but since it's been down for over a year, it's unlikely it will ever return. A few years ago, I tried to make a siterip with HTTrack Website Copier, but it didn't work. Fortunately, itcan be found in the Internet Archive, but normally only first 500 entries can be accessed for each letter. I remembered that in earlier versions, there were "next" and "previous" buttons which allowed to easily jump to next entries. The buttons were mapped to query strings like &view=smd&cat=X&start=1001&count=500, where &cat is the first SMD code letter, &start is the page and &count is number of components on the page. The &count was always 500 and &start was always multiples of 500, i.e. 1, 501, 1001 etc. Luckily, IA has most of these "standard" queries archived. So I made a Windows batch file that automatically generates the queries, adds them to IA URLs and tries to download them withWget. Whole URLs look like this:https://web.archive.org/web/20190812222308id_/http://chip.tomsk.ru/chip/chipdoc.nsf/vc1!readform&view=smd&cat=S&start=1001&count=500It works suprisingly well - if the page doesn't exist for the given date, the IA servers automatically offer one that does. The resulting HTML file even has the date on which it was archived. However, it also has one unfortunate side effect: some SMD entries are duplicates and some are missing, because pages generated from different database updates don't align.I chose August 2019 as the default date, beause it seems the updates stopped after that. You can easily change the date in the batch file - maybe you'll fiddle with it, you could obtain a better copy. But don't run the script needlessly, because it hammers the IA servers with many requests. For simplicity, it generates 40 URLs for each SMD letter, because "A" has by far the most entries. Other letters have fraction of that, so most of the resulting HTML files will be empty (zero bytes). You need to manually delete them afterwards. Also, some files will have only ~12KB - those are existing pages, but with no SMD entries. These also happen because pages from different database versions don't align; I deleted them too. Some other notes:-Notice the "id_" string after the date. It directs IA servers toprovide only the original page, without the IA toolbar. That reduces file size significantly.-URLs contain special characters like ! and &. These are a real pain in Windows batches, you need toescape them properlywith ^ characters or replace them with %xx URL codes.-The main script downloads only letters 0-9 and A-Z. Other letters always have only one page, so I prepared a much simpler script for them. I didn't download the russian letters and ? because it's highly unlikely I'll ever need them.-When you have the files on your drive,you can mass-search them for a given code, because all the entries are in HTML tables with the same syntax. For example, if you want to find code EA7, search the files for string <tr><td>EA7-Thanks to this simple syntax, it should be possible to concatenate the files to one giant table. But I'll leave that to others.

author: hanakp
author_rank: Regular Contributor
timestamp: October 09, 2022, 09:07:27 am
content: Second archive with the site rip.

author: zcxgs
author_rank: Newbie
timestamp: November 23, 2023, 04:32:37 pm
content: thank you so much for that.I have always using tomsk.ru for chip marking. but it's down now.the 2 zip files are very useful for me.thanks.

author: RoGeorge
author_rank: Super Contributor
timestamp: November 26, 2023, 11:00:12 am
content: Thanks!Once unpacked, the html files can be put together in a single directory then searched from Dolphin with CTRL+SHIFT+F, open the found .html and CTRL+F again in the browser.