|
|
|
start date: Wed, 1 Aug 2007 20:15:47 -0700,
posted on: microsoft.public.dotnet.framework.aspnet
back
| Thread Index |
|
1
Jim Bancroft
|
|
2
Alexey Smirnov
|
|
3
Laurent Bugnion, MVP
|
|
4
Laurent Bugnion, MVP
|
|
5
Laurent Bugnion, MVP
|
|
6
Alexey Smirnov
|
|
7
Alexey Smirnov
|
Iterating and downloading a URL that lists files?
Is there a way to open a URL, one that shows nothing other than a directory
listing, and iteratively go through the list to download the files?
Date:Wed, 1 Aug 2007 20:15:47 -0700
Author:
|
Re: Iterating and downloading a URL that lists files?
On Aug 2, 5:15 am, "Jim Bancroft" wrote:
> Is there a way to open a URL, one that shows nothing other than a directory
> listing, and iteratively go through the list to download the files?
Hi Jim,
you can use a HttpWebRequest with a StreamReader to get the page from
the URL, then the content of the page can be parsed with a regular
expression to get the list of all links and then again use
HttpWebRequest to get the files...
Hope it helps
Date:Thu, 02 Aug 2007 00:08:22 -0700
Author:
|
Re: Iterating and downloading a URL that lists files?
Hi,
Alexey Smirnov wrote:
> On Aug 2, 5:15 am, "Jim Bancroft" wrote:
>> Is there a way to open a URL, one that shows nothing other than a directory
>> listing, and iteratively go through the list to download the files?
>
> Hi Jim,
>
> you can use a HttpWebRequest with a StreamReader to get the page from
> the URL, then the content of the page can be parsed with a regular
> expression to get the list of all links and then again use
> HttpWebRequest to get the files...
>
> Hope it helps
I did that a long time ago with a Java applet. I then discovered that
the page format was different in Netscape (back then) and IE. I hope
things are more standard now!
HTH,
Laurent
--
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 10:50:26 +0200
Author:
|
Re: Iterating and downloading a URL that lists files?
On Aug 2, 10:50 am, "Laurent Bugnion, MVP"
wrote:
> the page format was different in Netscape (back then) and IE. I hope
> things are more standard now!
Laurent, do you mean that the default directory listing depends on the
client browser? It depends on a web server and not on a browser. I
have no example for IIS, but here's the one for Apache
Default settings:
http://tomcat.apache.org/tomcat-6.0-doc/default-servlet.html
Example how it looks on the website:
http://cohred.org/cohred/content/
When directory browsing in enabled on a web site and there isn't a
default document available, IIS will display the contents of the
directory as a similar page and it looks the same in IE, and other
browsers
Date:Thu, 02 Aug 2007 03:04:33 -0700
Author:
|
Re: Iterating and downloading a URL that lists files?
Hi,
Alexey Smirnov wrote:
> On Aug 2, 10:50 am, "Laurent Bugnion, MVP"
> wrote:
>
>> the page format was different in Netscape (back then) and IE. I hope
>> things are more standard now!
>
> Laurent, do you mean that the default directory listing depends on the
> client browser? It depends on a web server and not on a browser. I
> have no example for IIS, but here's the one for Apache
Back then, the client browser used to add content to the directory
listing page. I tested again right now in Firefox and IE, and apparently
this is not the case anymore, so you're lucky!
I am talking about Netspace 4 and IE4, that was back in... not sure...
97 maybe?
Anyway, good luck with your project!
Laurent
--
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 13:22:18 +0200
Author:
|
Re: Iterating and downloading a URL that lists files?
On Aug 2, 1:22 pm, "Laurent Bugnion, MVP"
wrote:
>
> I am talking about Netspace 4 and IE4, that was back in... not sure...
> 97 maybe?
Huh? We are talking about ASP.NET :-)
Date:Thu, 02 Aug 2007 17:59:27 -0000
Author:
|
Re: Iterating and downloading a URL that lists files?
Hi,
Alexey Smirnov wrote:
> On Aug 2, 1:22 pm, "Laurent Bugnion, MVP"
> wrote:
>> I am talking about Netspace 4 and IE4, that was back in... not sure...
>> 97 maybe?
>
> Huh? We are talking about ASP.NET :-)
Yeah I was rambling. Your post awoke old nostalgies, sorry :-) I'll shut
up now. :-)
Laurent
--
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 20:12:53 +0200
Author:
|
|
|