Aller au contenu

Photo

Auto Downloader Problem


  • Veuillez vous connecter pour répondre
17 réponses à ce sujet

#1
c i p h e r

c i p h e r
  • Members
  • 261 messages
I've never had any serious problems with the auto downloader before, but just recently, it seems to have a problem getting past a file. It downloads it fine
from the server, stores it into the campaign folder, extracts it properly, but
then just stops progressing. It downloads quite a few files leading up to that one w/o any problems.

What's curious is that both the lzma file
and the decompressed file are in the campaign folder. So it seems to be getting hung up on something, but what? I've confirmed that the extracted file is fine (not corrupted) and I've also deleted the lzma file to see if it will progress with that file removed, but it just downloads the lzma again (even though the extracted file is there) and just gets stuck there. It's as if it can't detect the extracted file.

There's plenty of disk space and there's nothing unusual about the file's properties as far as I can tell.

Does anyone have any idea what the problem could be? Has anyone experienced this behavior? Is there a limit on the number of files it can transfer/sync? I'm perplexed!

:unsure:

#2
IxionReborn

IxionReborn
  • Members
  • 84 messages
Yeah my friend had the same issue I think, it was just one file. He got the file manually off the website of the server, continued using the auto downloader afterwards and it worked fine after that.

Other than that, not sure. He doesn't have the best internet though, maybe it's that.

Good luck man

#3
c i p h e r

c i p h e r
  • Members
  • 261 messages
Crikey, this is frustrating. If it's not one thing, it's another. File's too big, file won't verify, transfer just hangs... I never had these sorts of problems with worldgate, and that didn't have an entire company behind it. Frustrating frustrating.....

Wish they would release the source under a non-commercial use license or equivalent.

#4
NWN DM

NWN DM
  • Members
  • 1 126 messages
Why would the lmza file be in your Campaign folder?

#5
c i p h e r

c i p h e r
  • Members
  • 261 messages
It downloads the lzma to the campaign folder because that's where the file (a DDS) ultimately resides. It's a campaign file. It successfully extracts the file but then doesn't delete the lzma, leaving both the uncompressed (extracted) file and compressed (lzma) file in the directory. It simply stops processing as though it's waiting on something...maybe a response from the file system?

The connection speed at this point also drops down to 0kbs so it's literally just sitting and waiting for something (presumably the extraction of the lzma file, which completed just fine). Totally bizarre.

Bypassing the file as Ixion suggested allows the ADL to continue but then it runs into the same problem with another file.

*bangs head on keyboard*

Modifié par ç i p h é r, 05 mars 2011 - 12:41 .


#6
NWN DM

NWN DM
  • Members
  • 1 126 messages
The couple of times I had a problem like this I re-named the files in question and removed the old versions (told the ADL to not download them). This was the only way I could get past it.

#7
Rokene

Rokene
  • Members
  • 23 messages
I have the exact same problem as you cipher. I didn't have problems until recently when trying to update files. Now it just refuses to or cannot verify files. Did you ever find a solution?

#8
painofdungeoneternal

painofdungeoneternal
  • Members
  • 1 799 messages
Try putting the campaign stuff in a hak as much as possible is my only real suggestion. Not sure if that is something that will work since some things just have to be in campaigns, but they don't seem to work as well with. Regardless one hak with that stuff is much better than a bunch of loose small files for over all performance.

Worldgate had it's share of issues as well, for the most part the issues with the ADL are all on the PW Admins side, where before the issues were with the end users. Since the PW admin is a lot more sophisticated relative to the end users, its a lot better now.

The big issue is just doing things step by step and not skipping things, and i've helped quite a few PWs get up and running. Generally the first time it works fine, but eventually they get more lax and start trying to speed things up and it gets hairy. However campaign files seem to have other issues.

The way i help folks solve problems, ( i was one of the first PW's to get up using the ADL and have helped a lot of PW admins sort out the issues )

1. Looking at the actual log files for the end users and the server, which is really the first step. ( in your temp folder %temp%\\nwn2 ) Can't remember the actual log paths but there is one for the server program, and one for your client, and you need to make sure you are on your actual server when you look at the server one, and vice versa.

2. If a file is an issue, go ahead and delete the lzma it creates, to force it to recreate the lzma and put that checksum into the lzma. Might be multiple files, so deleting all recently changed lzma, or files you know should have changed is advisable. In extreme cases deleting all the lzma is useful. 

If you deleted a file entirely, well the toolset won't delete it from the xml file, so you will need to edit the xml file to remove it, or just delete the xml files entirely.

If the file is not even downloading at all, check that your ftp site or drop box has the actual file there. This is rarely the issue. Usually it's downloading and its failing since it thinks its the wrong one.

3. Close the toolset with a saved module. Work in directory mode so you can see dates on the files.

4. Open toolset, open module, prep client files.

5. Save module, close toolset.

6. Open toolset, prep server files.

7. Save module, close toolset.

8. Compare dates on the xml files in your module folder, campaign folder, etc with corresponding xml files in your prepped files folder. If they are not the same, copy the files manually. Check that file dates on lzma you deleted just updated in the prepped folder as well, if they are missing or not a new date, you likely are staging to another folder you don't know about. ( look in toolset prefs and compare the paths involved )

9. Carefully upload to the server, doublechecking dates again.

10. Restart the server ( this is a HUGE thing people over look, if you don't do this it still is using the old xml files )

11. Test it again ( if it's still an issue, review the logs and see if there is a new problem, if it's repeating either try deleting the xml files or hopping on IRC and asking for help )

The above for the most part catches almost all problems. Generally the person involved takes a lot of coaxing to get them to undertake the process "since they already tried that", but the issue is the details and most people are having a problem because they are overlooking something. The ADL is not that user friendly for the PW admin, but then it's very user friendly for the end user. Grinning fool if we had another patch could easily fix the issues which cause the above problems.

We have quite a bit of access to the ADL via DLL's right now, so those things are fixable, either as standalone, or via toolset plugin.

Modifié par painofdungeoneternal, 28 juillet 2011 - 11:42 .


#9
Rokene

Rokene
  • Members
  • 23 messages
Lol. Okay thanks pain. I actually got so frustrated I just deleted all the files even the campaign stuff and redid everything. Same error but I'll just go through the steps as you laid out and read over the pdfs for the ADL and then try again. :P I appreciate your response.

And I'll post the details here when I'm done and I read your other post as well about another guy having trouble with his files and actually changed my mod to directory too and I'm even running it as directory now, much easier. Fixed my crashing issues with the toolset along with grinning fools plugin as well but still getting those verifying errors. >< Anyway, I'll climb back into my hole naow. :D

#10
Rokene

Rokene
  • Members
  • 23 messages
Yeah same thing happened it couldn't verify files. :/ Successful in downloading but failed verification.

Steps I took:

1. Upload the directory+haks+tlk to my dedicated server.
2. Made sure to delete all associated files for a fresh install (Of the module.) Like staging folder, haks, campaign folder, tlk. Then replace it with the files uploaded.
3. Open up toolset on the dedicated server to open up the uploaded directory. Then scanned and staged files + server files. They all ended up in the documents\\nwn2 folder like it is supposed to.
4. Uploaded files to FTP server.
5. Started up server with NWNX4.
6. ADL failed to verify campaign.CAM. (So just decided to upload the entire campaign folder and have people download that and extract it in the appropriate place.)
7. Reconnected to server after installed campaign.CAM manually. The ADL seem to accept the campaign.CAM. So it moved on to the next file and failed to verify that.
8. So I then closed the server and went into staging/server with the campaign, modules, tlk, haks and thought okay I'll just replace everything with this. Instead of overwriting I decided to do everything manually. I went and deleted the folders that were supposed to get replaced.
9. Then I copy and pasted the server files into the documents/nwn2.
10. Ran nwnx4 again to run the server.
11. Reconnected to ADL, same error. Accepted campaign.CAM which I replaced manually but failed to verify the next file. >O

The onyl thing I didn't do is check the logs because I couldn't find the logs. =.= I even compared dates. They were different at first but I simply deleted the module and replaced it with the prep server files module which is exactly the same but witha  different date since it was just a copy made today.

Also the next file that it failed to verify was a .PFX so it wasn't an area problem either. I actually thought I should jsut rebake everything but it even failed to verify a .PFX.

I don't understand how it worked the first time and then refuses to work the next when trying to update the server. D:

P.S: Oh and I looked at the client files in the module section where it is suppose to download and extract the files. I see the .PFX file there but still in LZMA format. So it actually didn't even try to extract it. :/

Do you think I should just prep client files and prep server files on my machine THEN transfer the files over to the dedicated server?

Modifié par Rokene, 29 juillet 2011 - 11:36 .


#11
Rokene

Rokene
  • Members
  • 23 messages
Okay, I got some other clues ... the .pfx.lzma file I'm looking at on the FTP server is 551 bytes for size and 4kb on disk but looking at the client modules folder where the ADL downloads the files to the size is completely different for some reason ... it's 8.02 KB size and 12KB on disk. And I can't extract it manually for some reason either. I have winrar and 7zip. :/

In fact, after testing I manually download the .pfx.lzma file to my desktop from my FTP server. I can extract it and get the .PFX with the right numbers as the original files in size comparison and further testing the ADL actualyl verifies the manually extracted .pfx.lzma file I downloaded from the ftp server and moves on to the next file. However the next file stops the ADL from proceeding further because it fails to verify. Seems like the ADL is corrupting it or something is happening to the file. :/

Modifié par Rokene, 30 juillet 2011 - 04:45 .


#12
Rokene

Rokene
  • Members
  • 23 messages
I finally found the fix for my problems. =.= After 4 straight days of debugging. The ADL and the FTP server seemed to have some kind of problem which I can't say for sure what it is ... but in your server download list where you list the FTP server you must put in ftp://yourserver.com or whatever your ftp server address is.

I just changed this one thing and it verified and downloaded all files. Even though in the ADL guide it says you can use http:// =.= which it still worked I downloaded the file from my FTP server but it corrupted for some reason ...

Anyway there you go peoples. Hope it helps some of you if you ever find yourself in this position. <.<

#13
painofdungeoneternal

painofdungeoneternal
  • Members
  • 1 799 messages
Yes you have to use a correct URL, if it won't download in a web browser, it won't download. http:// on a ftp file just can't work.

hint, stop using FTP, use dropbox. Much better for your players, FTP just does not work very well. You will have lots of players complaining about download speeds. ( it also lets you automate the uploading of the files just by setting the client files folder in toolset prefs to your public drop box folder ).

#14
Rokene

Rokene
  • Members
  • 23 messages
Oh really. <.< I just couldn't find a general link to list to point to I guess I will take a look. I'm already using drop box to sinc folder between my dev comp and the server comp. :D

#15
painofdungeoneternal

painofdungeoneternal
  • Members
  • 1 799 messages
you right click the file to get the download link.

I put the files for my pw in "drop box/public folder/name of pw"

I put this into the path for my toolset prefs.

Then for ftp, i get the public download path, and "/name of pw/" portion and prior i put in as the ftp/http address.

Voila, you stage, it's already up on the files they download.

( This is being done on a lot of PW's at this point )

#16
Rokene

Rokene
  • Members
  • 23 messages
Yeah that's cool cause I'm paying for my ftp right now and seems very handy. =.= I'll try and get it setup tomorrow. :D

Modifié par Rokene, 31 juillet 2011 - 08:13 .


#17
OrdinaryMan21

OrdinaryMan21
  • Members
  • 48 messages
So are you saying that using an http: site is a problem? Unsure here. Am using a folder off of my webserver, which considering it is a VPS should be relatively quick. Should we only be using FTPs?

#18
painofdungeoneternal

painofdungeoneternal
  • Members
  • 1 799 messages
Use dropbox, it's free too and it syncs.

Use the webserver as a second host url in case something happens to dropbox. http is fine. I'd avoid ftp entirely since it's for the most part going to be taken over by script kiddies, the ftp technology is pretty ancient.

Compared to amazon's servers, your server is going to just slow things down for the players.