If these archives share the same custom archive, you might find it easier to create separate custom archives for each (re-using the same WordPress Archive cell).
No, because you only use one Layout at a time, and the archive cell is just working with the existing query generated by WordPress for the archive indicated by the URL the visitor is on.
If you assign a particular Layout to the category archive then when a user visits the category archive URL on the front end Layouts pops up to say "I'll render the content for this page", and then when it comes to what to render it looks at the archive cell to determine what to render on that part of the page.
It makes no difference that other Layouts may also include the same archive cell.