What does embedding database information do???

(31 posts)
  • AnthonyM
    Member

    I've tried shutting down ACDsee and it wants to embed databasde data into the files?
    What does this mean exactly? The hlp seems a bit ambiguous.

    If I send an image to a client, will the image contain my hard drive folder location and other potentially private information?
    Do I have to explicitly strip this information before sending to a client? How would I do that?

    I unfortunately work in a multi-user environment, and although ACDSee knows nothing about this I often find that someone else has moved or renamed my files. The feature of ACDSee being able to recreate its database by embedding data sounds like a pretty cool idea but I don't know enough about the security aspects to say if that would be a good idea or not.

    Can someone shd more light on EXACTLY what happens with this data embedding?

    Posted On September 10, 2008 - 04:58 PM (1 year ago) (Permalink to this post)
  • Marc Sabatella
    Moderator

    AnthonyM said:

    Can someone shd more light on EXACTLY what happens with this data embedding?

    Mostly, it contains the information visible in the Database pane of the Properties window: rating, notes, keyword, categories, etc. I cannot say definitely say it would *never* contain folder info or anything else you didn't to share, since I don't know all the variables involved, but when I tried it, there really was nothing but what shows in the Properties->Database pane.

    If you run the operation on files that don't support embedded XMP (eg, proprietary RAW files, BMP files, most non-image files), it goes to a sidecar, which is a plain text file you can view with any text editor. So that would be the easiest way to see what it looks like exactly in your particular situation.

    As for removing stripping it out in the cases where it really is embedded, I'm assuming that ExifTool could do that. you might want to check to see if you can safely remove *all* XMP info or if it is also containing IPTC fields you do want to preserve.

    Posted On September 10, 2008 - 06:04 PM (1 year ago) (Permalink to this post)
  • AnthonyM
    Member

    Thanks, that is how I read the Help file but wasn't sure.

    I guess for now I'll leave that turned off. I certainly do not want to accidentally leave private info embedded in a photo I send out. Especially if someone on my end adds a note in the database to the effect of: "This guy was a real jerk to work with"
    Unprofessional, yes.. but also a real possibility. :-)

    It seems there should be an ACDSee option to remove this info. It is a rather one sided feature to not think about the reverse and to require that I hunt down and obtain another third party tool to do that.

    I know I'm too picky... but I think ACDSystems needs some photographers on their staff... or better yet photographers that just happen to have done software engineering/design and software quality assurance for their real jobs for the last decade. :-) :-)
    This sort of thing really should not have gone past the drawing board stages.

    Posted On September 10, 2008 - 06:29 PM (1 year ago) (Permalink to this post)
  • What is "Database->Embed Database Information into Files" actually meant to do?

    I set it going, it ran for 17 hours with a stay on top dialogue box containing a message telling me it was retrieving a list of files that needed to have database base information embedded into them. I run a service that allows me to control the "what's on top" attribute, without it ACDSee Pro would effectively take over the monitor- I call that arrogance. The dialogue box has a Cancel button that does not work, I have to use Taskkill from the command line to terminate ACDPro 2.5 when it's in this state.

    Does anyone know if/when the manual for 2.5 will be available, I appreciate the help text has sort of been updated - but I prefer manuals.

    For those wondering what XMP actually is, the spec's here -- http://www.adobe.com/devnet/xmp/pdfs/xmp_specification.pdf. Hopefully ACD will publish some infomation on the tags they use, perhaps within the aforementioned absent manual.

    Apart from protection against database loss putting the d/b info into the images as XMP opens up another potentially useful possibility; the use of the external search tools.

    You can pick up an IFilter for XMP here, http://www.ifiltershop.com/xmpfilter.html. I am fairly certain that the Windows Desktop Search (WDS) and Vista's search engines use the same IFilters as the Indexing Service as originally implemented in NT4 and used on Sharepoint Servers, and XP; the latter is where it got its bad reputation. In its original implementation MS neglected to ship a pundit friendly interface; the latter, like sheep, collectively pronounced the Indexing Service to be a bad thing and suggested it be turned off. I am not sure to what extent existing image format Indexing Filters are able to index IPTC data, they do index some EXIF fields.

    XMP is not just for images it can be applied to PDF's and several other file formats (HTML is another), and via sidecar files it can sort of be applied to any other file types. It must be recognised that sidecar files are not generally a feature of the native file system, they just another file with the same path name and a different extension that an application recognises. Personally I would have preferred that "sidecar"'s be implemented as a named data stream (aka Alternate Data Streams - ADS). ADS's are yet another good idea killed off by the pundits, they collectively decided that ADS's could be a place in which to hide viruses and the like; what utter nonsense, once again the lack of a pretty interface confused the poor things.

    Posted On September 11, 2008 - 11:08 PM (1 year ago) (Permalink to this post)
  • The definitive list of fields that are written to the file from our database is:

    Caption
    Author
    Notes
    Category
    Ratings
    Tagged
    ACD DB Date
    Keywords

    All of these fields are visible in the Properties Pane - so you can be clear what is written out. Hope this helps.

    Cam

    - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    Cam Carmichael
    Product Manager, ACDSee

    Posted On September 12, 2008 - 02:56 AM (1 year ago) (Permalink to this post)
  • gae
    Member

    I realized,to my disappointment,that ACDSee added an XMP sidecar file to all my dbase access file and pdf files which where in separate directories so I had to delete each one of them patiently.
    Can anyone explain me why please ?

    Posted On September 12, 2008 - 03:40 AM (1 year ago) (Permalink to this post)
  • Tankred
    Moderator

    ACDSee adds a sidecar file to every object that isn't capable of adding the metadata in the header. If you don't want ACDSee to add sidecar files to files that aren't pictures, try to exclude the folders in which they are.

    Posted On September 12, 2008 - 04:55 AM (1 year ago) (Permalink to this post)
  • Cam Carmichael said:

    The definitive list of fields that are written to the file from our database is:

    Caption
    Author
    Notes
    Category
    Ratings
    Tagged
    ACD DB Date
    Keywords

    All of these fields are visible in the Properties Pane - so you can be clear what is written out. Hope this helps.

    Cam

    - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
    Cam Carmichael
    Product Manager, ACDSee


    This highlights the problem I have with the new Embed feature. The user has only one choice: to use this feature and have ACDSee embed all these fields for every image file in the database, or not to use the feature at all. My point is that while I might want ACDSee to update an image file because I changed, say, the Caption, I probably wouldn't want it to do so just because I, say, (Orange) un/Tagged an image. I also might not want the embedding to apply to all my image files, but I can't restrict it as I can with Batch Set.

    Posted On September 12, 2008 - 08:29 AM (1 year ago) (Permalink to this post)
  • Gae said:

    I realized,to my disappointment,that ACDSee added an XMP sidecar file to all my dbase access file and pdf files which where in separate directories so I had to delete each one of them patiently.
    Can anyone explain me why please ?

    Like me you probably lost your exclusions settings, in my case it resulted in my thumbs database expanding from 600MB to 3GB. Had I not noticed that then it probably would have added sidecars to everything here too.

    But I don't understand why sidecars are created for pdf's, which by definition support embedded XMP metadata, if you're minded you can read all about doing that starting here http://www.pdflib.com/developer/xmp-metadata/xmp-in-pdfa/

    As noted earlier the embed d/b info operation ran for 17 hours, before I killed it. Since re-establishing my exclusions and after a rebuild my thumbs databases went down to about 1G. Now when I exit 2.5 the "finding files that need embedded data" comes up for < 20secs, before it asks if I want to embed the data, I've not yet been game enough to say yes.

    Posted On September 12, 2008 - 08:32 AM (1 year ago) (Permalink to this post)
  • Sam Dring
    Moderator

    John_R said:

    This highlights the problem I have with the new Embed feature. The user has only one choice: to use this feature and have ACDSee embed all these fields for every image file in the database, or not to use the feature at all. My point is that while I might want ACDSee to update an image file because I changed, say, the Caption, I probably wouldn't want it to do so just because I, say, (Orange) un/Tagged an image. I also might not want the embedding to apply to all my image files, but I can't restrict it as I can with Batch Set.

    Agreed John and I would like to on/off at file/folder level for iptc/exif-writing also

    Posted On September 12, 2008 - 09:23 AM (1 year ago) (Permalink to this post)
  • Marc Sabatella
    Moderator

    Gae said:

    I realized,to my disappointment,that ACDSee added an XMP sidecar file to all my dbase access file and pdf files which where in separate directories so I had to delete each one of them patiently.
    Can anyone explain me why please ?

    That's part of the new metadata embedding feature - if it can't embed, it creates a sidecar. As others have noted, you can exclude folders you don't want db info maintained for. Or, if you do want db info but just don't care about having it embedded for these files, you can turn off the option to create sidecars under Tools->Options->Database. You can also turn off the embed metadata reminded in the same dialog if you wish to diable metadata embedding completely and go back to how 2.0 worked, with metadata maintained in the central db only.

    Posted On September 12, 2008 - 11:25 AM (1 year ago) (Permalink to this post)
  • Paul Silk
    Member

    From what I can see this new embed database feature only writes to the custom tab (and not the IPTC file proper) so quite what the use of this feature is I am at a loss to understand as it can only be read by ACDsee! If someone can enlighten me I Would be grateful.

    Posted On September 12, 2008 - 06:04 PM (1 year ago) (Permalink to this post)
  • Tankred
    Moderator

    IPTC proper? Pro 2.5 writes the data to the XMP header which is a standardized area, too. Nothing more, nothing less.

    Posted On September 12, 2008 - 07:51 PM (1 year ago) (Permalink to this post)
  • Tankred said:

    IPTC proper? Pro 2.5 writes the data to the XMP header which is a standardized area, too. Nothing more, nothing less.

    I was under the impression that the IPTC data is not only a "standard area" that can be used in some types of image files (JPEG, TIFF, JP2 etc) but not others (eg BMP, GIF ?) and that it must ONLY contain "standard data items" as defined by the relevant IPTC committee, most data items are optional.

    My impression of XMP is that it is much more generic. It does have its "own" standard area, but its contents are not controlled in the same way as the IPTC controls the IPTC data area. Thus the data "allowed" within the XMP area for an image will be quite different to that of a document. Furthermore what ACDSee writes to a JPEG XMP data may be different to what Adobe might write - unless the latter defeines & publishes its "standards" and the likes of ACD adopt them. Even then what gets written to an image file's XMP data may bear little resemblance to what gets written to an MP4, MPEG4, ODL or OOXML files XMP area.

    Posted On September 12, 2008 - 11:31 PM (1 year ago) (Permalink to this post)
  • Paul Silk
    Member

    Tankred said:

    IPTC proper? Pro 2.5 writes the data to the XMP header which is a standardized area, too. Nothing more, nothing less.

    Ok lets see if I can make this clearer with pictures.

    I import a virgin jpeg image with no iptc (xmp) data except standard camera make in the caption 1st image left. I now add caption and keywords in ACDSees data base and then use the new feature Database >embed Database Info in Files. Now when i go toIPTC Fields it is not there middle image but is only in the custom field see right image.

    </farm4.static.flickr.com/3002/2852921776_05989cd52e_o.jpg" border="0" class="linked-image" />

    Now if I look for this data in any other IPTC compliant program like exprssion media , panda exif or Adobe it is not there.

    </farm4.static.flickr.com/3102/2852921836_74d7fda214_o.jpg" border="0" class="linked-image" />

    So I ask yet again what use is the new feature "embed Data Info IN FILES except for ACdsee's own pesonel use which is already done in the normal database if it writes to fields other IPTC compliant programs cannot read ?

    Posted On September 13, 2008 - 03:03 AM (1 year ago) (Permalink to this post)
  • Paul said:

    If someone can enlighten me I Would be grateful.

    Paul, allow me to have a go at doing that. I ran the "Database->Embed Database Information in Files" process against my test dataset which has approx 20K images.
    From what I can see this new embed database feature only writes to the custom tab (and not the IPTC file proper)
    I assumed I would see an XMP section somewhere, but in Custom I just have the same old Database, File, EXIF and IPTC sections, nary a sign of an XMP section -- what see you?

    But If I look at the images with EXIFTool then I can see XMP data that <u>can only</u> have been written by ACDSee 2.5 because it contains a representation of my category hierarchies.

    Whilst the EXIFTool software shows the "Categories" data in its GUI browser I can't coerce it into allowing me to export that XMP field, nor can I edit it the data, which is a pity because that means there's no easy way for me to get to grips with the manner in which ACDSee Pro 2.5 writes the hierarchies, all I can see is a truncated string in the EXIFTool GUI.

    so quite what the use of this feature is I am at a loss to understand as it can only be read by ACDsee!
    The data is there to "reconstruct" the database, including category hierarchies. This is the principal "stated purpose" of the XMP data, from what I can see that ought to be possible, but I have yet to import an image containing ACDSee pro 2.5 specific XMP data.

    It is probably true to say that the XMP data that ACDSee Pro 2.5 writes can only "processed" by ACDSee pro 2.5; but it can be "read", albeit at a primitive level, by other tools. Maybe as I've suggested elsewhere this might include external search tools, providing they support IFilters. Google GDS used to support IFilter's but I'm not sure that that's still so. The MS search tools support IFilters, as does AImAtFile and another one whose name escapes me.

    I suggest the lack of processability of ACDSee's XMP data by other software is entirely mutual. There appear to be no de jure or even de facto standards for how data such as hierarchical categories (or keywords) ought be represented. For IPTC and EXIF fields I think (hope) that the convention is use the same "labels" as are used in EXIF and IPTC data blocks. However I question the efficacy of writing EXIF and IPTC data to the XMP block, unless one is prepared to dispense with the IPTC and EXIF data blocks -- I doubt that the industry is ready to do that - more on this below.

    But - why cant I see the ACDSee Pro 2.5 generated XMP data in its native from within ACDSee Pro 2.5. I should not have to resort to 3rd party tools to read what ACDPro just wrote!.

    It would seem that what ACDSee Pro 2.5 writes to the XMP data block gets appended to what's already there, I think the same is true of Photoshop. given that there are no standards this is pretty much as one would expect.

    On the other hand idManager writes all the EXIF data, all the IPTC data and its own database information to the XMP block; it also writes IPTC and EXIF data to their respective blocks, i.e we have data reduncancy, which sounds good - but it ain't necessarily so. IMO, idImager has created itself and its users a problem. If the value of Photographer in the IPTC block and the XMP block are not the same -- because the IPTC value was changed with something other than idImager (e.g. Photoshop, Photomechanic, EXIFTool, ACDSee Pro ...) -- then which value is correct. I don't think individual fields are time stamped, even if they were, then is what I see evidence of plagiarism, or merely an error correction?

    I doubt that this has bought you into a state of true enlightment, in fact its quite likely that you are even more confused. But always remember, wisdom is confusions child - who said that - me.

    Posted On September 13, 2008 - 03:21 AM (1 year ago) (Permalink to this post)
  • Tankred
    Moderator

    Paul said:

    Now when i go toIPTC Fields it is not there middle image but is only in the custom field see right image.

    ...

    Now if I look for this data in any other IPTC compliant program like exprssion media , panda exif or Adobe it is not there.

    ...

    So I ask yet again what use is the new feature "embed Data Info IN FILES except for ACdsee's own pesonel use which is already done in the normal database if it writes to fields other IPTC compliant programs cannot read ?

    Short answer: the XMP data can be read by metadata tools but not each and every metadata tool can read the complete XMP area. If you want to use ACDSee's XMP information with another application, just try Exiftool. With this tool, you can look into the embedded metadata and export it into various formats. So for me, this really is a handy feature that ensures me that my metadata is safe and sound embedded in the files and can be restored everytime even without using ACDSee. Besides, the "new feature" allows multiple use of ACDSee and all your pictures including metadata, e.g. on a desktop PC and a notebook, without the need to exchange the whole database between the two computers. Just copy the pictures, start ACDSee and the metadata's there. Now if that's of no use!?

    Posted On September 13, 2008 - 04:11 AM (1 year ago) (Permalink to this post)
  • Paul Silk
    Member

    Thanks for that Philip, and yes as just a photographer a lot went over my head. So basicly in laymens terms for all intent and purpouse it there to make rebuilding of the database easier in case of ACDSee's main database corrupting by writing the info to a custom file in the image that only ACDSee can use to rebuild the database if needed?

    Posted On September 13, 2008 - 04:12 AM (1 year ago) (Permalink to this post)
  • Sam Dring
    Moderator

    Is this not a lot more simple than we are making it?
    Any changes in the iptc pane and exif pane are (have always been) written immediately to file or sidecar and available to view in any other app
    All other entries in the list above (Database pane) may be written to file or sidecar at your discretion in order that you have the security of all metadata being held within the file.

    Posted On September 13, 2008 - 04:24 AM (1 year ago) (Permalink to this post)
  • Paul said:

    Ok lets see if I can make this clearer with pictures.

    I import a virgin jpeg image with no iptc (xmp) data except standard camera make in the caption 1st image left. I now add caption and keywords in ACDSees data base and then use the new feature Database >embed Database Info in Files. Now when i go toIPTC Fields it is not there middle image but is only in the custom field see right image.

    Now if I look for this data in any other IPTC compliant program like exprssion media , panda exif or Adobe it is not there.

    So I ask yet again what use is the new feature "embed Data Info IN FILES except for ACdsee's own pesonel use which is already done in the normal database if it writes to fields other IPTC compliant programs cannot read ?

    XMP is not an IPTC de facto standard, nor is it intended to replace IPTC, at least not in near/medium future.

    XMP is a de-jure standard initiated by Adobe as a "vehicle" via which metadata can be applied to any object whether it be media, an executable program, a spreadsheet, a program's source code or anything else.

    The 2008 Draft IPTC standard does specify how IPTC specific data items are to be represented within the XMP block, But it does not mandate that only IPTC data items shall be contained with the XMP block of an image. Nor does W3C mandate that only its data items can be represented in an XMP block within an HTML object, same goes for the PDF 1/A standards, and various other things that use an XMP block in which to store metadata.

    So to put it simply, ACDSee Pro2 specific data (eg Categories) does not show up as IPTC data because it's not IPTC data, any more than YCbCr Positioning is IPTC data.

    idImager's Catalog Labels get written to the XMP data block, but you won't see them in anything other than idImager or a low level tool such as EXIFTool.

    All the data items available in Media Expression 1 are EXIF or IPTC items, I don't know about ME2.

    If I needed portability across different photo managers then I would assiduously avoid the use of data items that ain't EXIF or IPTC data items, this rule would apply each and every photo manager product I used.

    Posted On September 13, 2008 - 04:36 AM (1 year ago) (Permalink to this post)

Subscribe to this topic via RSS

Reply »

You must log in to post.