SD WiFi Replacement

[Jeff8356]

blhoward2,

This may give you a better idea of what files/folders get  transferred from my machine everyday.  It's the output of the script I use to copy the data:

Code:

STR.edf
       112,072   0%    0.84kB/s    0:01:31 (xfr#1, to-chk=62/10175)  
DATALOG/20220202/
DATALOG/20220202/20220203_020033_CSL.crc
       112,080   0%    0.84kB/s    0:01:31 (xfr#2, to-chk=42/10175)
DATALOG/20220202/20220203_020033_CSL.edf
       112,880   0%    0.85kB/s    0:01:31 (xfr#3, to-chk=50/10175)
DATALOG/20220202/20220203_020033_EVE.crc
       112,888   0%    0.85kB/s    0:01:31 (xfr#4, to-chk=49/10175)
DATALOG/20220202/20220203_020033_EVE.edf
       113,816   0%    0.86kB/s    0:01:31 (xfr#5, to-chk=48/10175)
DATALOG/20220202/20220203_020038_BRP.crc
       113,824   0%    0.86kB/s    0:01:31 (xfr#6, to-chk=47/10175)
DATALOG/20220202/20220203_020038_BRP.edf
     2,743,724   0%   28.29kB/s    0:01:33 (xfr#7, to-chk=46/10175)
DATALOG/20220202/20220203_020039_PLD.crc
     2,743,732   0%   28.27kB/s    0:01:33 (xfr#8, to-chk=45/10175)
DATALOG/20220202/20220203_020039_PLD.edf
     2,983,944   0%   30.72kB/s    0:01:33 (xfr#9, to-chk=44/10175)
DATALOG/20220202/20220203_020039_SAD.crc
     2,983,952   0%   30.70kB/s    0:01:33 (xfr#10, to-chk=43/10175)
DATALOG/20220202/20220203_020039_SAD.edf
     3,090,972   0%   31.79kB/s    0:01:33 (xfr#11, to-chk=42/10175)
SETTINGS/ABR.log
     3,090,984   0%   31.78kB/s    0:01:33 (xfr#12, to-chk=41/10175)
SETTINGS/DLL.log
     3,094,196   0%   31.81kB/s    0:01:33 (xfr#13, to-chk=32/10175)
SETTINGS/ELI.log
     3,094,208   0%   31.80kB/s    0:01:34 (xfr#14, to-chk=29/10175)
SETTINGS/ERR.log
     3,094,428   0%   31.80kB/s    0:01:34 (xfr#15, to-chk=28/10175)
SETTINGS/RGL.crc
     3,094,432   0%   31.80kB/s    0:01:34 (xfr#16, to-chk=15/10175)
SETTINGS/RGL.tgt
     3,094,616   0%   31.79kB/s    0:01:34 (xfr#17, to-chk=14/10175)
SETTINGS/TRR.log
     3,094,628   0%   31.79kB/s    0:01:34 (xfr#18, to-chk=11/10175)
SETTINGS/TXC.log
     3,094,640   0%   31.78kB/s    0:01:34 (xfr#19, to-chk=10/10175)
SETTINGS/TXE.log
     3,094,652   0%   31.77kB/s    0:01:34 (xfr#20, to-chk=9/10175)
SETTINGS/TXH.log
     3,094,664   0%   31.77kB/s    0:01:34 (xfr#21, to-chk=8/10175)
SETTINGS/TXW.log
     3,094,676   0%   31.76kB/s    0:01:34 (xfr#22, to-chk=7/10175)
SETTINGS/ZRL.log
     3,094,688   0%   31.40kB/s    0:01:35 (xfr#23, to-chk=0/10175)

sent 1,579,544 bytes  received 1,367 bytes  16,049.86 bytes/sec
total size is 2,872,942,798  speedup is 1,817.27

That's a one session night for my AS10 Autoset.  Two or more session would have more DATALOG data.  Other makes and models will likely be different also.

[blhoward2]

Thanks, I’ve seen those on my machine. How uniform is this across brands? I’m assuming they all have their own schemas?

[Crimson Nape]

Each CPAP brand has their own directory structure and file types, different from others.

[blhoward2]

Each CPAP brand has their own directory structure and file types, different from others.

I figured, so I need to account for those. Can someone outline what they look like? I could make a ResMed specific version of this in about 15 minutes, it’s accounting for the others that takes some thought.

I actually have a FlashAir so while I’m happy to help with this it already meets my needs. I’d rather not have to dig back through OSCAR’s source code.

[Jeff8356]

blhoward2
Have you encountered any issues with iCloud yet? Today is the fourth time it choked on me. Either while uploading or deleting it will suddenly stop and change to "offline for maintenance" then no access for about an hour.
I think iCloud may see it as suspicious activity from my end....

[blhoward2]

blhoward2
Have you encountered any issues with iCloud yet?  Today is the fourth time it choked on me.  Either while uploading or deleting it will suddenly stop and change to "offline for maintenance" then no access for about an hour.
I think iCloud may see it as suspicious activity from my end....

No, and with testing I’ve probably run hundreds of copies of varying amounts of garbage files I had lying around in the last few days.

[blhoward2]

blhoward2
Have you encountered any issues with iCloud yet?  Today is the fourth time it choked on me.  Either while uploading or deleting it will suddenly stop and change to "offline for maintenance" then no access for about an hour.
I think iCloud may see it as suspicious activity from my end....

It seems iCloud was having issues in general (according to the Apple state) and I did have this when I signed in today. Restarting and disabling/enabling iCloud Drive on my phone fixed it. This isn't related to the shortcut, they are have token issues.

---

Ok all, I think I have this figured out and now the Shortcut only downloads data modified after the last sync. Please give it a whirl. It still won't let me post links even though I have more than four posts, so I'll ask the moderator to edit the link in here and in place of the other one up top. https://www.icloud.com/shortcuts/bd5829e...54b7729ea8

[Jeff8356]

blhoward2,
My iCloud seems to be working alright now, thanks for the tip...

The changes you made seem to be working good so far.  With my test data I was able to upload data from 2 days ago, manually change the date in the import_log.txt, then run the shortcut again to import new data I added to the SD card.   So far so good.  Nice work....

Next step is for me to use some actual real data and import it into a test profile into OSCAR.

[Jeff8356]

Quick update,

Seems I was wrong about iCloud being fixed for me.  Got the same error a couple of times again.  Seems to only be if I am using the web browser to view my files.  I don't see the error using Finder so it may just be a browser thing.

I tried using my full data today.  2.88GB (2+ years) on a spare class 4 SD card.  The Shortcut seemed to read the card fine and took ~30 minutes.  My iPhone has plenty of storage room available, so not an issue.  And with ~4.5GB of space available in iCloud, shouldn't be an issue either.
The problem came with my iPhone uploading the data to iCloud.  After 3.5 hours and a nearly dead iPhone battery, there were only 4 days of data in the DATALOG folder.  Not what I would have expected.

I'm using an iPhone 7 (over wifi) so it may just be grossly underpowered for moving that much data quickly.  That combined with possible issues with iCloud may be contributing factors.  With an ISP connection of 200/10 I don't think there is any great concern with speed, even with the lower upload speed it should have had much more data transferred.

Tomorrow I will try uploading the data to iCloud using my computer first.  Then use the Shortcut to update and see what happens.  It seemed to work fine with the smaller datasets.

[blhoward2]

Interesting. I moved several GB a few times. I wonder if your SD card is just so slow it’s timing out? Mine is a fairly fast and it only took 3-4 minutes to move 5 GB.