Corrupt Data File?

dmbgamer

i am a long time quicken windows user. I have computers in two locations that need to access the same quicken data file. I recently tried to use OneDrive to manage this process. I would backup the data file after each use and then open that backup copy when i used the next computer.

When i opened the file this week, i found that i could not download transactions from Fidelity and American Express.

I deactivated the accounts but when i tried to set them up online again, i received the below message.

I have validated and super validated the files but that did not solve the situation.

Has using OneDrive permanently corrupted my file?

Any help in resolving this would be appreciated.

CaliQkn

@dmbgamer glad you got your data file clean and in good working order again. I know it was a lot of steps to go through, but it will make a difference, in my opinion.

Those steps are the standard way to share a data file between two computers. Nothing really guarantees that your data file won't have corruption, but the steps you outlined will definitely go a long way to prevent it.

CaliQkn

https://community.quicken.com/discussion/7963645/corrupt-data-file

The short answer to your question is "yes".

You don't mention how you restore the backup but never restore the backup directly from OneDrive. Copy the backup file to the local (C:) drive and then restore it.

Also, never open the same file on both computers at the same time—this can corrupt your data. And, don’t run Quicken directly from a cloud-synced folder (like Dropbox or OneDrive). Instead, copy the file locally before opening it.

If you’re just looking to view or make light edits from another device, you can use Quicken on the Web. It syncs with your main file and avoids the risks of file corruption—but it won’t keep two desktop installations in sync.

What you can do to try to fix your current data file -

Making a copy of your data file using Quicken's "copy file" process is good for fixing data file corruption -

1. Make a backup of your data file. Also, make backups during this process, just in case you need to go back a step.
2. In the Account List, check the “Transaction Download” column and make note of any accounts using EWC+ for connection method. You will need this information in a later step.
3. Validate your data file. Click on File→Validate and Repair File, then select "Validate". Click "OK". Review the "Validate & Repair log" for any messages that need to be acted upon.
4. Super Validate your data file. Same as step #2, except hold Ctrl-Shift when clicking on "Validate and Repair File".
5. Do a "Copy File" to create a copy of your data file. This process forces a rewrite of code and fixes some file corruption issues. It will also clear out online connection "remnants" for all accounts. Click on File→Copy or Backup File, and select "Create a copy or template", and then click Next.
6. On the next screen, leave the defaults as is. You can change the new file name and location, if you wish. Click on "Save Copy".
7. During the copy process, you will be asked to provide a password for the new file. If you don't want a password, hit ESC.
8. When the process completes, switch over to the new file. For each account, on the General tab in Account Details, blank out the Financial Institution Name and Account Number. This forces Quicken to go through the full activation process from the start.
9. For EWC+ accounts, go to each of your financial institutions’ websites and log into your online banking account. Locate the section where connected apps or third-party access is managed and make sure to unlink or disconnect Quicken from your accounts on the bank’s end. This may be listed under "Security," "Settings," or "Authorized Apps" depending on the institution. If you do not see a link or a third-party authorization, it may have already been deleted by the deactivation process in Quicken.
10. Reactivate online services for all accounts in the new data file, by using “Add Account” and carefully linking to existing accounts in Quicken. Do not use “Set up now” on the Online Services tab of Account Details.

I know there are a lot of steps here but I have found personally that they go a long way in fixing a lot of data file issues.

dmbgamer

Thank you very much for taking the time to provide such a detailed response to my post. I followed your steps and it appears to have solved my problems!

In the future, I plan to follow the following steps to continue using the same Quicken file on two computers:

After using Quicken on Computer 1, I will backup the file to OneDrive.

When I am ready to use Quicken on Computer 2, I will copy the backup file down to the C drive and restore from there.

In each instance, the Quicken file will be located on the local drive of each computer when in use.

Will this prevent data corruption?

CaliQkn

@dmbgamer glad you got your data file clean and in good working order again. I know it was a lot of steps to go through, but it will make a difference, in my opinion.

Those steps are the standard way to share a data file between two computers. Nothing really guarantees that your data file won't have corruption, but the steps you outlined will definitely go a long way to prevent it.

markus1957

With regard to your use of OneDrive. It's been a few months since I stopped using Quicken on 2 machines with OneDrive, but my sequence was a little simpler. I still use OneDrive but only use Quicken on one machine now.

I did not do manual copies or "backups" other than the normal auto-backups and never did a restore to open on Machine 2. That defeats the purpose of OneDrive which is meant to keep a single file in sync on both machines automatically without user intervention.

I did learn to pause syncing on OneDrive while using Quicken in order to avoid datafile corruption. OneDrive has a habit of grabbing the data file for sync while Quicken is still using it and then corrupting it. It seems to have gotten a bit better lately but whether you actually use the datafile on 2 machines or not, it is better to pause syncing on OneDrive while using Quicken.

My steps-

1. Pause syncing on OneDrive
2. Open Quicken file in default Quicken directory on Machine 1
3. Close Quicken after work or OSU is completed
4. Resume syncing on OneDrive and let it sync Quicken data file and any auto backup
5. When needed on Machine 2, upon resuming from sleep or startup, let OneDrive sync Quicken data files first
6. Pause syncing on OneDrive on Machine 2 before opening Quicken
7. Open Quicken file on Machine 2 also stored in default Quicken directory
8. Close Quicken after work is complete
9. Resume syncing OneDrive and let it sync.

Adding- you have a cloud file associated with your corrupt data file that is potentially still operating in the background. You might consider deleting that and any other old cloud files you are not using.

dmbgamer

thanks for the insights. How do you delete the cloud files?

markus1957

https://community.quicken.com/discussion/comment/20496960#Comment_20496960

Edit>Preferences>Quicken ID & Cloud Accounts. Click the "Cloud accounts associated with this Quicken ID" link.

Sync must be On under Mobile & Web preference for cloud accounts to display. I leave it On but have zero accounts enabled for Sync.

CaliQkn

@markus1957 if you right click on your OneDrive folder (or any sub-folder) and select "Always keep on this device", I have found that you do not need to manually pause syncing on OneDrive. OneDrive will automatically pause syncing when a file is in use, and resume syncing when it becomes free again.

When I open a synced data file in Quicken, OneDrive pauses syncing for that file while it's in use. After I close the data file, it resumes syncing the file. The key is to make sure to select the option "Always keep on this device".

Jim_Harman

There was a widespread Quicken/OneDrive problem a while ago that was triggered when Quicken would momentarily close the data file during certain operations, including opening a password protected file, Validating, and doing backups. OneDrive would grab the file to sync it before Quicken could re-open it, causing error messages, long delays, crashes, and sometimes corrupted files.

Manually pausing OneDrive while running Quicken would avoid this issue, and eventually Quicken and/or Microsoft made some changes that appear to have made the problems go away.

But running Quicken in any situation where there might be contention for the data file is still risky, leading to continuing strong recommendations not to store your active data file in a folder that is controlled by OneDrive or any other cloud storage system.

See this discussion

https://community.quicken.com/discussion/7941390/r52-33-unable-to-open-data-file-on-first-try-then-opens-after-pointing-to-file-edit75

.

CaliQkn

@Jim_Harman I agree, it does seem that Quicken and/or Microsoft have made some changes that makes using OneDrive with Quicken better. I don't advocate using your active Quicken file directly from OneDrive, but the syncing process has much improved in my opinion to the point that one doesn't need to manually pause OneDrive. Again, I think using the option "Always keep on this device" is key because you are always using a local copy of the data file. And it's then the cloud copy that is being synced to the local data file. From my own experience, the sync process has become lightning fast. Syncing my data file take only seconds. And, it automatically pauses and resumes syncing when needed. I have even shut down my computer in the middle of a sync and when I restart the computer, the sync automatically resumes.

I don't use Quicken on more than one computer, but one of these days, I would like to do some testing with OneDrive and see if that "Always keep on this device" option makes sharing a data file easier and safer.

markus1957

https://community.quicken.com/discussion/comment/20497019#Comment_20497019

So, I tested the "Always keep on this device option" and it behaves no differently than the default option of 30 days of residence on the local drive until reverting to cloud storage until next use. As mentioned, there was a recent change that does seem to keep the qdf locked away from OneDrive regardless of the OneDrive option chosen for the file.

I also changed _synclog.dat and ofxlog.dat to test them. Those files continue to chatter away trying to sync in OneDrive during an OSU. That can't be good for performance or data integrity.

In the past, the one surefire way to corrupt the qdf was to leave OneDrive on while Quicken pushed an unannounced forced update while a password protected file was in the process of being opened. I'm not going to test that, but have you found that is no longer the case?

Jim_Harman

The problem with any timing-related issue like this is that it might work just fine for months and then some unusual combination of events or another change to Quicken or OneDrive might cause it to fail. This is clearly not a supported configuration that Quicken tests exhaustively in each new release, even though Microsoft is making it harder and harder to avoid using OneDrive.

I suppose we can always reload a backup if something goes wrong, but I would just as soon avoid the risk.

markus1957

https://community.quicken.com/discussion/comment/20497043#Comment_20497043

Although it should be (the supported configuration) given the almost default nature of OneDrive being setup in modern Windows devices.

CaliQkn

@markus1957 I have opened and used my active data file with OneDrive for over a year now with absolutely no issues or errors. I think using that option makes the difference. I am not so sure that it is the same as the 30 day option. What I have done is instead of trying to suppress OneDrive, I am allowing it to install fully and run as intended, and again, it seems to be working just fine with Quicken. I also update releases as soon as they are available without any issues.

CaliQkn

@Jim_Harman as I mentioned, I have been using OneDrive with Quicken for over a year and have no issues or errors of any kind. But, I do not share a data file between multiple computers. That is where I draw the line. It is almost impossible to install Windows without activating OneDrive. An it's when you try to circumvent installing OneDrive is when you run into issues. Same with Quicken, I have fully turned on sync and it has never been working better.

I've noticed a trend with connection issues, and its the same users that continually are having issues. The common theme I can see that they are the ones that are so intent on disconnecting from syncing with "the Quicken cloud" and in the process they are disconnecting their accounts.