• 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

28 core Mac Pro only processing about 1 frame every 2 seconds

Offline
#1 ryanflynn
Hey friends,

I've enabled all 56 threads in preferences. On the initial preview of a folder in LRTimelapse 5.6.3 pro, its only generating 1 frame every two seconds. It looks like there is only 1 instance of Adobe DNG converter is running. This is only on the initial run I'm seeing this low performance.

After making my changes in Lightroom, it builds the preview extremely quickly with dozens of instants of DNG converts running at the same time.

Computer specs:
28 core Mac Pro, 384 gb ram, 8tb SSD and Pro vega II duo video card running Mac OS Big Sur 11.6

Camera:
Hasselblad x1d II

here is a video of the initial preview, note the lack of DMG converter instances and cpu usage
https://vimeo.com/617157435

Here is the speed difference after the light room step:
https://vimeo.com/617157724


Thanks for your help!
Ryan
Offline
#2 ryanflynn
Any ideas? Is this normal?
Offline
#3 Gunther
It is normal. The initial Camera Previews are currently only being read single threaded. This process doesn't use the Adobe DNG Converter. Currently the Visual Preview development is multithreaded.
I have it on my agenda to further improve the performance on the tasks that are currently not multithreaded yet.
Subscribe to: LRTimelapse Newsletter, Youtube Channel, Instagram, Facebook.
Offline
#4 ryanflynn
Thanks man
Offline
#5 ryanflynn
Getting the multi-thread in the initial preview would take my workflow down to minutes instead of an hour + If there is anything I can do to help with this, let me know!
Offline
#6 Gunther
It's strange... normally that doesn't take so long since LRTimelapse just extracts the embedded previews for from the raw files. The only case where it really takes long is for Raw files, where the camera doesn't embed any preview. Could you please post your log here after loading the initial loading of a sequence?
Subscribe to: LRTimelapse Newsletter, Youtube Channel, Instagram, Facebook.
Offline
#7 ryanflynn
Ah thats smart! Unfortunately it looks like your hypotheses is correct, its not reading the embedded previews. it only takes seconds to build them through the raw with multicore support. Anyway to quickly enable that?

Here are the logs:

Code:
[2021-09-29 21:43:03] INFO: Log file was created at: /Users/ryanflynn/Documents/LRTimelapse/LRTimelapse.log
[2021-09-29 21:43:03] INFO: Documents folder at: /Users/ryanflynn/Documents
[2021-09-29 21:43:03] DEBUG: Loading settings from /Users/ryanflynn/Library/Application Support/LRTimelapse/user.props
[2021-09-29 21:43:03] DEBUG: ICC-Profile defined in settings doesn't exist. Turned off color management.
[2021-09-29 21:43:03] INFO: LRTimelapse 5.6.3 (2021-09-25) Build 717
[2021-09-29 21:43:03] INFO: (c) 2021 Gunther Wegner
[2021-09-29 21:43:03] INFO: https://lrtimelapse.com
[2021-09-29 21:43:03] INFO: Java version: 16.0.1 (64bit) from AdoptOpenJDK
[2021-09-29 21:43:03] INFO: Running on: Mac OS X locale: en_US
[2021-09-29 21:43:03] INFO: OS Version: 11.5
[2021-09-29 21:43:03] INFO: Found 56 processor cores.
[2021-09-29 21:43:03] INFO: Java runtime: 64 bit
[2021-09-29 21:43:03] INFO: Licensed to: Ryan Flynn, Marina del Rey - Professional License.
[2021-09-29 21:43:03] DEBUG: Registered Tiff-Reader: com.twelvemonkeys.imageio.plugins.tiff.TIFFImageReader@40844aab
[2021-09-29 21:43:03] DEBUG: Registered Tiff-Reader: com.sun.imageio.plugins.tiff.TIFFImageReader@5c08c46a
[2021-09-29 21:43:06] DEBUG: Launched worker with 56 threads.
[2021-09-29 21:43:06] INFO: Loading directory structure
[2021-09-29 21:43:06] DEBUG: Initializing directory chooser
[2021-09-29 21:43:06] DEBUG: Start path: /Users/ryanflynn/Desktop/Desert/Hassleblad/arch life 2
[2021-09-29 21:43:06] DEBUG: Building user interface
[2021-09-29 21:43:06] DEBUG: UI scaling factor: null
[2021-09-29 21:43:06] DEBUG: Building Table
[2021-09-29 21:43:06] DEBUG: Setting header renderer
[2021-09-29 21:43:06] DEBUG: Register cell editing
[2021-09-29 21:43:07] DEBUG: Updating column widths
[2021-09-29 21:43:07] DEBUG: Create table popup
[2021-09-29 21:43:07] DEBUG: Enabling drag-drop
[2021-09-29 21:43:07] DEBUG: Done creating UI
[2021-09-29 21:43:07] DEBUG: Creating UI-bindings...
[2021-09-29 21:43:07] DEBUG: Preview Color Management not activated. You can activate it in the Settings.
[2021-09-29 21:43:07] DEBUG: Launched worker with 56 threads.
[2021-09-29 21:43:07] DEBUG: Checking for render tasks in: /Users/ryanflynn/Documents/LRTimelapse/LRTInterface.txt
[2021-09-29 21:43:07] DEBUG: Launching ExifTool: /usr/local/LRTimelapse/exiftool
[2021-09-29 21:43:07] INFO: ExifTool: 12.25
[2021-09-29 21:43:07] DEBUG: Exif Tool available.
[2021-09-29 21:43:07] DEBUG: DNG Converter available.
[2021-09-29 21:43:07] DEBUG: MPEG Encoder available.
[2021-09-29 21:43:07] INFO: Detected 1 screen:
[2021-09-29 21:43:07] INFO: Screen 1: 3008 1692
[2021-09-29 21:43:07] DEBUG: Setting window position
[2021-09-29 21:43:07] DEBUG: Starting version check...
[2021-09-29 21:43:07] DEBUG: Showing UI
[2021-09-29 21:43:07] DEBUG: Initializing import dialog...
[2021-09-29 21:43:07] DEBUG: Cleaning up temp dir
[2021-09-29 21:43:07] DEBUG: Using temp-dir: /var/folders/bc/bn4k0r1d42125dwr5685q9zh0000gn/T/lrt_14513237092122457620
[2021-09-29 21:43:08] INFO: Locating last selected folder...
[2021-09-29 21:43:08] INFO: ...done locating last selected folder.
[2021-09-29 21:43:08] INFO: Latest Version of LRTimelapse: 5.6.2 (2021-09-04), installed Version: 5.6.3 (2021-09-25)
[2021-09-29 21:43:09] DEBUG: ...done initializing import dialog.
[2021-09-29 21:43:09] DEBUG: Latest Version of Adobe DNG Converter: 13.3.0 (13030000) Installed Version: 13.4 (13040000)
[2021-09-29 21:43:09] DEBUG: Memory: [max|314592] [used|959] [free|313633]
[2021-09-29 21:43:16] INFO: --- Loading directory: /Users/ryanflynn/Desktop/Desert/Hassleblad/test
[2021-09-29 21:43:16] DEBUG: Loading sequence properties from /Users/ryanflynn/Desktop/Desert/Hassleblad/test/.lrt/lrtsequence.properties
[2021-09-29 21:43:16] WARN: Sequence properties-file not found.
[2021-09-29 21:43:16] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:17] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:18] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:18] DEBUG: Finished loading XMP data in 2 sec.
[2021-09-29 21:43:18] DEBUG: 3FR sequence with 128 images loaded.
[2021-09-29 21:43:18] DEBUG: Memory: [max|314592] [used|2271] [free|312321]
[2021-09-29 21:43:18] DEBUG: Buffer size for ExifTool: 12
[2021-09-29 21:43:18] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:19] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:20] DEBUG: Sequence shot in unknown mode
[2021-09-29 21:43:20] DEBUG: Timestamp Data complete!
[2021-09-29 21:43:20] ERROR: Cannot compress preview to jpg.
[2021-09-29 21:43:20] DEBUG: Sequence is new or was processed with LRT < 4.0
[2021-09-29 21:43:20] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:20] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:22] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:24] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:26] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:28] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:30] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:32] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:34] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:36] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:38] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:40] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:42] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:44] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:46] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:47] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:49] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:51] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:53] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:55] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:57] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:43:59] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:01] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:03] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:05] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:07] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:09] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
[2021-09-29 21:44:11] DEBUG: Didn't get a visual preview. Trying fall back to Demosaicing.
...
[2021-09-29 21:47:33] DEBUG: Done loading previews.
[2021-09-29 21:47:33] DEBUG: Memory: [max|314592] [used|1843] [free|312749]
Offline
#8 Gunther
As a work around you could try to convert those files to DNG with the DNG Converter first, before doing the LRTimelapse workflow. But of course this will also take some time but avoid the time outs that you get currently.

In the mean time let me analyze those files. Please send me a sequence of 10 of those raw files so that I can have a look.
Just put them into a zip file and send them via https://fromsmash.com/ or wetransfer to support(at)lrtimelapse.com
Subscribe to: LRTimelapse Newsletter, Youtube Channel, Instagram, Facebook.
Offline
#9 ryanflynn
Not a bad idea. Just sent you the files Smile
Offline
#10 ryanflynn
ooops forgot to zip them. hope thats ok!

...also check out: