Comments on: Ajax Crawling with PHP and Curl? http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/?utm_source=rss&utm_medium=rss&utm_campaign=ajax-crawling-with-php-and-curl Keiron's daily take on life, the internet and the world around us! Sun, 22 Jan 2012 17:23:42 +0000 hourly 1 http://wordpress.org/?v= By: Keiron http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27998 Keiron Thu, 31 Dec 2009 15:25:53 +0000 http://www.skillett.com/?p=684#comment-27998 Looking back at the code that's running in the cron job I think I implemented almost entirely in Curl and it worked! Looking back at the code that’s running in the cron job I think I implemented almost entirely in Curl and it worked!

]]> By: Keiron http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27997 Keiron Thu, 31 Dec 2009 15:02:55 +0000 http://www.skillett.com/?p=684#comment-27997 lol, as you may have noted: <ul><li>I replied at 5 to midnight, I wasn't going to go looking for the code then!</li> <li>The post is over a year old, I can't remember where I stored the code, or how I implemented it.</li> </ul> I'll go looking for the code when I'm on my own machine and see if I can make a generic enough post about it to fit most scenarios! That said, I have just launched <a href="http://www.office-automation.co.uk">Office Automation</a> because there are a lot of people out there who could use this sort of functionality and don't have the coding skills to make their lives easier! lol, as you may have noted:

  • I replied at 5 to midnight, I wasn’t going to go looking for the code then!
  • The post is over a year old, I can’t remember where I stored the code, or how I implemented it.

I’ll go looking for the code when I’m on my own machine and see if I can make a generic enough post about it to fit most scenarios!

That said, I have just launched Office Automation because there are a lot of people out there who could use this sort of functionality and don’t have the coding skills to make their lives easier!

]]> By: marvellin http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27996 marvellin Thu, 31 Dec 2009 14:50:44 +0000 http://www.skillett.com/?p=684#comment-27996 wow, that was really useless. bookmark killed wow, that was really useless. bookmark killed

]]> By: Keiron http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27995 Keiron Wed, 30 Dec 2009 23:54:51 +0000 http://www.skillett.com/?p=684#comment-27995 I forget how the code works now, but it did what I needed in the end! We've just launched www.office-automation.co.uk based on feedback from clients on that sort of work, if you've got something you'd like us to take a look at then let me know? I forget how the code works now, but it did what I needed in the end!

We’ve just launched http://www.office-automation.co.uk based on feedback from clients on that sort of work, if you’ve got something you’d like us to take a look at then let me know?

]]> By: marvellin http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27993 marvellin Wed, 30 Dec 2009 19:04:25 +0000 http://www.skillett.com/?p=684#comment-27993 So what do you use now to get this done? Watir or still Crowbar? Could you try to teach the general steps? ;) thanks, i am actually at the same contest. So what do you use now to get this done? Watir or still Crowbar? Could you try to teach the general steps? ;)
thanks, i am actually at the same contest.

]]> By: Keiron http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27989 Keiron Tue, 29 Dec 2009 12:29:21 +0000 http://www.skillett.com/?p=684#comment-27989 Yes, after a fashion! Yes, after a fashion!

]]> By: marvellin http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-27988 marvellin Tue, 29 Dec 2009 10:35:20 +0000 http://www.skillett.com/?p=684#comment-27988 Did you already succeed in doing this? Did you already succeed in doing this?

]]> By: Keiron http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-16196 Keiron Sun, 30 Nov 2008 09:57:16 +0000 http://www.skillett.com/?p=684#comment-16196 I've tried the Crowbar approach with a little success, but can't achieve exactly what I want. The problem is I need to be able to write this to be completely automated, with no intervention! And then it needs to be able to insert the data in a database for analysis later as well :( I'm willing to pay for it, if it can achieve all of those things! I’ve tried the Crowbar approach with a little success, but can’t achieve exactly what I want. The problem is I need to be able to write this to be completely automated, with no intervention! And then it needs to be able to insert the data in a database for analysis later as well :(

I’m willing to pay for it, if it can achieve all of those things!

]]> By: Magicroundabout http://www.skillett.com/technology/computers/programming/php/ajax-crawling-with-php-and-curl/comment-page-1/#comment-16134 Magicroundabout Sat, 29 Nov 2008 20:51:45 +0000 http://www.skillett.com/?p=684#comment-16134 I briefly Tweeted about the possibility of using a synthetic transaction tool to do this, but I think you're already thinking along those lines with the tools you've linked to. There may be better GUI-driven tools around, but it may be a case of what are you willing to pay for? In the meantime, looks like you might be off to Ruby school! I briefly Tweeted about the possibility of using a synthetic transaction tool to do this, but I think you’re already thinking along those lines with the tools you’ve linked to.

There may be better GUI-driven tools around, but it may be a case of what are you willing to pay for?

In the meantime, looks like you might be off to Ruby school!

]]>