News

The latest news about rexCrawler releases, changes, and future versions.

Confused? Find out what rexCrawler is about.

Contact form updated

posted Sep 26, 2013, 11:13 PM by Todd Boyd

In a not-so-surprising turn of events, the strange web widget I was using as my contact form is no longer functional. I've adjusted the link in the sidebar to go to my blog's contact form. Cheers!

rexCrawler is now open source!

posted Sep 5, 2012, 8:50 AM by Todd Boyd

After a bit of internal debate, I've decided to open source the rexCrawler project. There is now a project repository on github.com; check it out! I'm still tweaking things a bit (ex. I need to add a .gitignore that will filter out the bin folder and any *.suo files), but you should be able to clone and compile without any adjustments.

Onward, to victory!

v2.5.0.3 released

posted Aug 17, 2012, 11:34 AM by Todd Boyd

I've released rexCrawler v2.5.0.3 - in this version, every last crash bug I could find has been squashed. It will also remember the options you passed through it in your previous crawl, but I may have added that in 2.5.0.2. Who knows?

v2.5.0.2 is here!

posted Dec 6, 2011, 12:30 PM by Todd Boyd   [ updated Dec 6, 2011, 12:42 PM ]

I've uploaded a zipped release of v2.5.0.2, which boasts a context menu on the results pane! You can copy your selection(s) to the clipboard, and even launch a selected file in its default application--which I use pretty often for source crawling. Another change--and this is one that has been requested by a few different people so far--is that the application will remember your settings from the previous crawl. It wound up being simpler than I imagined to implement, and I am disappointed in myself for not putting that feature into the product much, much sooner.

I've also reorganized the way that the crawler thread cleans up after itself (namely, that it now actually does clean up after itself, instead of being aborted rather unceremoniously). This has lead to a reduction in exceptions to the point that I haven't been able to throw a normal situation at the crawler that caused it to let anything slip through. (Don't take that as a challenge, however, as I wasn't attacking it with any particular fervor.)

In the next version, I hope to have worked out a convenient and straightforward way to manage IFilter searches (such as the contents of PDF and Word 2007+ files, etc.). I'm having a bit of trouble trying to decide how to let the user mix and match IFilters with plain text searches; as an example, HTML files' tags will be ignored (and only text nodes will be scanned) when using IFilters in an "all or nothing" approach. As a web developer myself, that is hardly what I'm looking for. Anyway... progress is ongoing.

As for v2.5.0.2, enjoy! I hope it makes someone else's lives easier. There are always going to be more robust solutions out there (such as grepWin and TextCrawler), but I still feel that rexCrawler's miniscule size and level of customization make it a worthwhile tool to maintain. I know I've been itching for a way to filter on path names using regex for some time in grepWin; that was the very first option that I implemented in the rexCrawler code.

As always, comments and suggestions are appreciated.

Updates coming soon!

posted Nov 18, 2011, 2:50 PM by Todd Boyd   [ updated Nov 18, 2011, 2:52 PM ]

I dusted off the rexCrawler source this week, and I started making some changes. The results grid now has a context menu for copying to the clipboard and opening the files listed. Additionally, I've added some more exception handling to prevent quite as many errors from popping up if you cancel the crawl or close the program prematurely.

I'm going to work a bit more on how the crawler thread is terminated--currently, it is simply aborted, which may lead to file time stamps being left untidy. Once that's in place, you can expect a release to be posted!

(Edit: I forgot that I had been working with IFilters for searching PDFs, Word documents, and such. Some of that will also be included in the next release.)

v2.5.0.0 released!

posted Mar 11, 2009, 1:41 PM by Todd Boyd   [ updated Mar 11, 2009, 1:45 PM ]

rexCrawler v2.5.0.0 has been released! The interface has been cleaned up a bit, among other things: a progress bar has been added, the results panel will now fill as matches roll-in (rather than after the crawler has finished completely), and the output file is flushed after each match so that all is not lost if the crawler crashes or is canceled.

Things to look forward to in the next release include context menus for the results panel and Microsoft Office file (.doc, .xls, etc.) searches!

Online documentation

posted Jan 15, 2009, 6:24 PM by Todd Boyd   [ updated Jan 20, 2009, 6:53 AM ]

I have added the contents of the Help file included with v2.4.5.0 to the website. Below the main navigation sidebar on the left-hand side of this website, you will now find a "Usage" sidebar with links to the individual elements of the UI and their documentation. Hopefully, this will help people who are a bit daunted by the magnitude of rexCrawler's level of configuration, and perhaps help them to decide which filter would best suit their needs.

--Todd Boyd
rexCrawler Author

v2.4.5.0 released!

posted Jan 13, 2009, 2:56 PM by Todd Boyd   [ updated Jan 13, 2009, 2:59 PM ]

The new version of rexCrawler has been released. However, you won't find any new features in the actual crawler. What I've done is created a Help menu system using Helpinator Free and embedded it in the executable file.

The Help menu contains descriptions of all of the UI elements and their purpose.

For the next release: Wildcard file name filtering and context menus for the results Grid View!

--Todd Boyd
rexCrawler Author

Contact form

posted Dec 22, 2008, 7:10 PM by Todd Boyd

In addition to overhauling rexCrawler, I've decided to put a contact form on the webpage. Feel free to e-mail me with questions, comments, suggestions, praise, criticism, and anything in-between that you think will make rexCrawler a better product. If it's within my means to code it, I will at least give your ideas due consideration.

--Todd Boyd
rexCrawler Author

Exposure

posted Dec 22, 2008, 7:01 PM by Todd Boyd

rexCrawler is getting a tad bit of exposure. It's been uploaded to freeware sites that I myself did not upload it to, and I've seen it discussed in a couple of freeware forums on the topic of desktop search programs. As such, I have decided that it's time to overhaul the program. There are several features that I have meant to include in the "public" version that I haven't yet moved out of my development sandbox. Well, that's going to change.

Coming soon, rexCrawler will have:
  •  full support for multiple extension matching (without the use of regular expressions)
  • the option to replace the text that is found (including the use of regular expression capture groups)
  • the ability to search through the text (stripped of formatting) in Microsoft Word documents, Excel spreadsheets, etc. (tentative)
  • several aesthetic changes, such as a link to the website, a prettier "About" menu, Help documentation, etc.
I've got some time away from class and work in the next couple of weeks, and I think this would be a good project to work on. rexCrawler is a product that I have put a lot of my own blood, sweat, and tears into. I put it out there on the off chance that it would help someone else accomplish what I needed to when I decided to write it. Now that at least a good handful of people (that I know about, and have been vocal) have found it to be a useful program, I feel like I owe it to myself--and the freeware community at large--to polish it up a bit so that power users and laymen alike can use it to suit their purpose. That was my original goal, and remains the primary goal.

--Todd Boyd
rexCrawler Author

1-10 of 11