You are not logged in.

Announcement

[2017.09.08] DeployStudio build v1.7.8 (checksum, release note).
[2016.08.26] DeployStudio build v1.6.19 (release note).
[2013.02.23] DeployStudio last universal build v1.5.17 (release note).

#51 2018-02-25 20:56:14

neo
Member
Registered: 2016-01-28

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

This have been busting my balls so hard the entire weekend.

Running 1.7.8 on the server. On server I can select "Create a a master from a volume" workflow and I can chose APFS as file system. So I have a workflow like that.

I've created a bootable high sierra DeployStudio USB stick with the DS Assistant and I boot the client from it.

But, when I run the workflow on the client APFS isn't in the format pop-up menu. =( So the image is saved as HFS and I cannot deploy that on these 5k 2017 iMac's. =(

So, what have i missed? Why can't I from the client create a APFS master...?

Thanks in advance





> mjsanders wrote:

> This thread is to post and share findings on restoring APFS and 10.13.

-https://support.apple.com/en-us/HT208020 states clearly that imaging is ONLY supported for re-installs of 10.13
-The required firmware updates are part of the upgrade process.

So : run a (net) install/upgrade from 10.12 to 10.13 to get the firmware.

What I have tested:

macoS 10.13beta8 , AutoDMG 1.8b537,DeployStudio 1.7.7

Here is what I did:
On Mac running 10.13b8 I created the AutoDMG image, (default settings) from the downloaded 'Install macOS High Sierra Beta' app.
The result is named : osx-10.13-17A358a.apfs.dmg

On the same mac I installed DeployStudio 1.7.7,  mounted the image just created, ran the DS assistant to create netboot set, used the mounted image as a source for the NetBoot set (I suspected recovery partition version mismatches)

Copied that .nbi to a 10.12.5 /server 5.3.1/DS 1.7.7 server, enabled the netboot set
Copied the osx-10.13-17A358a.apfs.dmg file to /Repository/Masters/APFS/ folder
Created a workflow with 3 steps: partition disk, restore image (with the APFS image created) and configure task (rename computer, create users, skip setup)

That worked fine on a MacBook Air 7,2 (that had installed 10.13 beta versions before), the result is a working 10.13b8 system, with the 2 configured users, and the usual AFPS layout (Macintosh HD, VM, Preboot and Recovery)

!! Yeah!!!! DeployStudio Rocks !!

The only catch so far is that I had to select 'first disk available' in the restore step.

I will share more experiences here, please do that too

Offline

#52 2018-03-05 12:21:45

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

You have missed that APFS support is ' limited ' , in this case: limited to RESTORE apfs images created with tools like AutoDMG, and works best with 'first disk available'
The CREATE MASTER will not work reliably with APFS volumes (as you have found out :-( )

Offline

#53 2018-03-05 20:08:30

neo
Member
Registered: 2016-01-28

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Mmm. Thanks for clarifying. I did give up and installed/confed the three machines manually. feels like it's time to move on to some other solution for deployment. Sad...

Offline

#54 2018-04-10 12:53:23

kwisher
Member
Registered: 2012-06-13

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

I am having no issues saving & restoring 10.13.4 APFS images using DS. My setup: DS server running 10.13.4, Server App 5.6, DS 1.7.8. Netboot image 10.13.3 using AutoDMG. I have found netboot image 10.13.4 not to be working.

My next task is to get the process working for iMac's with HDD. From reading this post it looks like I need to extract the firmware and create a deployable package, is that correct?

TIA

Offline

#55 2018-04-10 12:59:59

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

No, the firmware as a pkg was a method that proves very unreliable, and discouraged by everone.
So please go the Netinstall (can be automated since 10.13.4) for updating Mac's to high sierra, and use DS for re-imaging

Offline

#56 2018-04-10 18:14:35

kwisher
Member
Registered: 2012-06-13

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

> mjsanders wrote:

> No, the firmware as a pkg was a method that proves very unreliable, and discouraged by everone.
So please go the Netinstall (can be automated since 10.13.4) for updating Mac's to high sierra, and use DS for re-imaging
mjsanders,

Can you please supply the exact instructions for this process?

Thank you.

Offline

#57 2018-04-10 19:00:26

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Not a real process, but I have this in a repair shop :

A)-a NetInstall 10.13.3 .nbi, to re-install the macOS on all Mac's that get a new disk/ssd. This includes all required firmware updates (since the orignal OS version is unknown)
B)-a DeployStudio Runtime .nbi (10.13.3) to restore dmg's created with AutoDMG to do the same for mac's that we know have had macOS 10.13 installed. (there is a choice of 10.10,. 10.12.6, 10.13.3/HFS and 10.13.3/APFS depening on model mac and request of owner)

Both hosted on the same Mac Mini 2011 with SSD, gigabit ethernet.
Both .nbi's take about 3 minutes to boot, and B) takes about 5 minutes to a finish, while A) takes about 35 minutes.
Did not have time to update to 10.13.4 yet.

Offline

#58 2018-04-10 19:05:58

kwisher
Member
Registered: 2012-06-13

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

As a test, I updated a older MBPro that still has a HDD from 10.12.x to 10.13.4. Saved the image to DS and restored it back to the same MBPro successfully. Next test will be to restore my official image to a HDD that has not be updated to 10.13.x.

Offline

#59 2018-04-10 19:11:22

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

The fact that some mac's can work with 10.13 without the firmware update does not prove that this will always work.
I recommend to stick to the apple recommendation: 'only upgrade by installing, not imaging'
We all know that i takes longer, but that is something we all have to accept. Just find new ways to automate the installation. (DEP, and scripting startosinstall which is just in developement on the macadmins slack channel)
Apple wants firmware to be updated for security reasons, and any next update may fail if you have a working (nonp-supported) imaging workflow.
There are more types of firmware involved (EFI is most important, but adapters, ssd, and ibridge firmware is updated too)

Offline

#60 2018-04-11 17:31:06

kwisher
Member
Registered: 2012-06-13

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

This is not fully on topic but kinda is. In my normal workflow I have a script to change the hostname, computer name & local host name, please see below. The script is now not working with DS 1.7.8, has something changed?

TIA

scutil --set HostName ${DS_HOSTNAME}
scutil --set ComputerName ${DS_HOSTNAME}
scutil --set LocalHostName ${DS_HOSTNAME}

EDIT: Disregard this, just needed to reorder my script differently in the workflow.

Last edited by kwisher (2018-04-12 13:55:56)

Offline

#61 2018-04-19 19:48:01

cotisimo
Member
Registered: 2017-12-12

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

> mjsanders wrote:

> No, the firmware as a pkg was a method that proves very unreliable, and discouraged by everone.
So please go the Netinstall (can be automated since 10.13.4) for updating Mac's to high sierra, and use DS for re-imaging


Can you tell me why?  We're looking at either upgrading the firmware as a standalone package on 1300 Macbook Airs or upgrading each to High Sierra to prep for a summer refresh, and even with Imagr and the OS installer on external USB3 drives it takes 53 minutes per machine.  Compared to a minute per for the FirmwareStandalone.pkg, and we're looking at weeks vs. days.  They are all the same model year and specs, and the testing I've done so far with the FirmwareStandalone has been solid - so I was wondering what red flags you have seen with it.

Many thanks.

Offline

#62 2018-04-19 21:06:37

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Why? the most important reason is that Apple says 'not supported' in https://support.apple.com/en-us/HT208020

The techniccal reason are the firmware updates (not only EFI, but touchbar, adapater, ssd, ..). If you want to use the unsupported method I think you may get away with the following:
I noticed that macbook airs with 10.12.6 and latest security updates have the same EFI firmware as 10.13.0-10.13.3 (10.13.4 has newer versions).
So if your fleet is at 10.12.6, re-imaging with 10.13.3 will probably work.
If you run the 10.13.4 (or later) combo update,(buy munki, or user) all macbooks will eventually get the same firmware update.

Since MacBook Air is a relative convential device, no touchbar, no T2, your chances of getting an unsupported deployment workflow to work are larger than orgs with iMac Pro's or MacBook pros with touchbar.

This is all unsupported, but may work, and if you test everyting , it is your call to use the supported, but long, process, or the unsupported but faster process.

Offline

#63 2018-05-04 11:06:42

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Hello, just to confirm I could successfully restore an AutoDMG APFS 10.13.4 base OS while using a 10.13.3 netboot set with DS 1.7.9 (10.13.4 does not work)
I left the latest Security Update (with firmware) to be installed at reboot with DS Software Update task
Most of my previous workflow still works, the only problem is how to create a local admin in DS workflow (skipping the setup assistant)
Using pycreateuserpkg works but with one major issue (that should be related to local users created with a script).
The secure token that is required for things like FileVault is not created using this method.
Any suggestion will be greatly appreciated!
Ciao
Carlo

Last edited by carlocarlo (2018-05-04 11:15:29)

Offline

#64 2018-05-04 15:04:22

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

I use the DS built-in option to skip the setup assistant and create users (from the list of devices where you define users.passwords, admin/non-admin/ etc)
In the configure step for a workflow

Offline

#65 2018-05-09 10:15:05

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Thank you @mjsanders
It took a couple of days to figure out the correct workflow order but now it seems that my rather complex workflow (base AutoDMG image 10.13.4 + additional pkgs + AD bind and the like) works fine
There are a few errors appearing in the log (some missing files while cleaning up at reboot) but I think those are minor
As far as the user creation is concerned, I get this error
...
ds_add_local_usersmain.sh - v1.5 (current date at imaging time)
ds_add_local_user.sh - v1.18 (current date at imaging time)
creating user 'admin' with UID=501 !
<main> attribute status eDSPermissionError
<dscl-cmd> DS error -14120 (eDSPermissionError)
Setting admin properties
Creating local home directory

but everything seems fine and secure token is present

I am not quite sure my DS scripts above are up to date (I had to move them from DSfolder/Scripts/10.5/)

Also, time zone is not set completely correctly
"Selected city not set, MacOs setup assistant might display...
SetNetworkTimeServer: time.euro.apple.com
NetworkTime is already on."

Still need to test with a Mac where High Sierra had not been previously installed
Not sure if latest Security Update installs the right firmware where needed
Many thanks again
Carlo

Last edited by carlocarlo (2018-05-09 10:16:27)

Offline

#66 2018-05-09 10:44:54

mjsanders
Member
From: Delft, Netherlands
Registered: 2008-09-02
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

I use the built-in workflow steps, and never seen the errors, but did not look into all logs since the user is created.

Is the user (s) created? if yes, ignore the error. ,
You moved the script for time zone setting? why not use the built-in step?

I typically use the default setting to allow location services to set the time zone , and not configure it with DS settings, so my experience is limited.

Offline

#67 2018-05-09 11:14:58

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Hello and thank you again!
I moved the scripts to create the user, not for time zone setting. I have used the built-in step to set the time zone
There's only the network time server and city to chose from...
Since I skip the setup assistant, I will try to use a script to allow location services, I don't know how I could do it otherwise... ...but maybe I am missing something obvious!

As far as the local user is concerned, I agree, as long as the secure token is present and everything seems OK, I am fine!

Offline

#68 2018-06-06 14:18:53

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Hello, just a quick note to confirm that DS runtime 1.7.9 created with 10.13.5 does not fix the issue when restoring an APFS AutoDMG base image
The errors in the logs after restoring progress reach 100% still refers to:

Inverting target volume...
APFS inverter faied to invert the volume
Command failure: XSTA
restoration failed

(obvious blinking question mark at reboot)

Everything seems to work fine with DS Runtime 10.13.3 and 10.13.5 AutoDMG base image
Cheers
Carlo

Last edited by carlocarlo (2018-06-06 14:20:42)

Offline

#69 2018-06-08 13:43:09

janthenat
Member
From: Sugar Grove, IL, USA
Registered: 2009-04-24
Website

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Interesting tidbit... I'm getting flashing question mark folder on physical Macs when restoring 10.13.5 base image from DS 1.7.8 (10.13.0 nbi), but when restoring the same base image to a VMWare Fusion vm it works OK.

On physical Macs, after restoring and getting the flashing question mark folder I netboot to DS again and running "diskutil afps updatePreboot" returns "Error: -69737: Unable to find boot helper partition".  Haven't figured out a way to fix that yet.

Offline

#70 2018-06-11 15:37:47

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Could it be an issue related to firmware update not being applied?
If you restore aworkflow with 10.13.4 autoDMG base image + 10.13.5 combo it should install the right firmware on top of the base image

Offline

#71 2018-06-14 17:01:05

msnowdon
Member
From: Massachusetts
Registered: 2014-06-19

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Hi, Ive been using DeployStudio for the past 8-9 years no problem.  I too am trying to figure out how to deploy High Sierra.  Ive done a lot of research and aware of Apple not supporting monolithic images.  I was late in getting a copy of High Sierra so I have 10.13.5.  I am running DeployStudio 1.7.8.

I first tried Apple's System Image Utility but it would always fail at the end. I then tried AutoDMG for the first time to create a dmg image to upload to DeployStudio Server.  It was very easy. It was an image of a MacBook Pro with a regular hard drive, so its not running APFS. The image AutoDMG creates is a APFS image (at least it seems to be - has the apfs.dmg extension.)  When I try to bring it down to another identical MacBook Pro, it fails during the restore process and changes from the DeployStudio Runtime to a Terminal windows with the High Sierra background. If I reboot, it gives me a flashing folder with the question mark as stated above (because I included the Partition phase in the workflow.) Prior to including that, it would reboot back to the OS. 

Unfortunatly, I cant get a copy of 10.13.3 unless someone knows of a way. 

Also, Im not sure what to have in my workflow.  When I did monolithic imaging, I had my workflow include Restore, Configure, AD Binding, and 3 packages,  I made a simple workflow for testing 10.13.5 which includes Partition, Restore, New User Form & Configure.  I wasnt sure if I should change some settings on the Restore phase such as unchecking "Restore System Recovery Partitions", unchecking "Delete machine dependent files & caches", and checking off "Preventive Volume Repair" and "Convert to CoreStorage"

Ive read a lot of other forums regarding using unsupported techniques using scripts and downloading the firmware package but it looks really confusing and doesnt seem to be a stable method anyways.

Not sure what to do.

Thanks

Mark

Last edited by msnowdon (2018-06-15 17:10:48)

Offline

#72 2018-06-15 17:11:31

msnowdon
Member
From: Massachusetts
Registered: 2014-06-19

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Update:

Built new NetBoot Set from a fresh 10.13.5 install.
Built new dmg file with AutoDMG latest release. The last time I accidentally used a pre-release.
Named the file with the hfs.dmg extension and placed it in the HFS folder of DSRepository (Not sure if this really does anything)
Tried bringing it down to a computer
Received an error about the disk being too small

Tried again taking out "Partition" out of the workflow.  Got through 98% when it got an error.

"APFS inverter failed to invert the volume - Invalid argument"
"Command failure: XSTA fail"

Found that AutoDMG has an Advanced Options. I chose to build the image as an HFS+J file since Im currently working with MacBookPros with HDD drives. I uploaded it to my repository and changed my work flow.  IT COMPLETED!

However while watching the Runtime window, I saw several errors during ds_finalize regarding dyld shared caches.  "Update_dyld_shared_cache: warning @rpath install name for system framework"  but it boots okay.

And I still need to figure out how to create a local admin account since I cannot logon to the computer because I have "Skip Apple Setup/Server Assistant" checked off in my workflow.

Thanks

Mark

Offline

#73 2018-06-15 19:19:49

msnowdon
Member
From: Massachusetts
Registered: 2014-06-19

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Update:

I used pycreateuserpkg (https://derflounder.wordpress.com/2017/12/24/creating-local-user-accounts-with-pycreateuserpkg/) to create a local admin account and added it to the workflow. Tested it and works fine. Base image & admin account completed in less than 5 minutes.  The first boot however takes a bit long because of the final tasks.

Now I am adding more packages to the workflow and going to see how that goes. : )

Offline

#74 2018-06-15 21:38:06

carlocarlo
Member
Registered: 2011-02-04

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Hello and thanks for the update
In my testing with pycreateuserpkg the only drawback was the user created that way does not have a securetoken so you cannot enable Filevault
The errors you get for the “inverter” are due to NBI deploystudio created with 10.13.5 when restoring APFS images
ASR changed from 10.13.4 onwards
Unfortunately DS runtime NBI has to be not higher than 10.13.3
With HFS+, Deploystudio behaves better like 10.12.x, no major issues although I have not tried creating and uploading “the old way” an HFS+ Image directly from DS NBI
You might try using the built in option to create a local user directly with DS, skipping Apple assistant
It worked for me despite some errors here and there in the logs
Have a nice weekend
C.

Offline

#75 2018-06-18 14:55:27

msnowdon
Member
From: Massachusetts
Registered: 2014-06-19

Re: DS 1.7.7 and APFS restore of 10.13 is possible :-) !

Thanks for the input.

I ran a workflow late Friday to image, bind to AD, install Microsoft Office 2016, Adobe Reader and enroll it in my MDM.

When I came in today, it was at the login screen. Looks like everything went well except for a Keychain error. I created a new login keychain and it seemed to fix that issue. Not sure why that happened.

Offline

Board footer

Powered by FluxBB