Patents Assigned to Shutterfly, LLC
  • Patent number: 11783192
    Abstract: A computer implemented method for recognizing facial expressions by applying feature learning and feature engineering to face images. The method includes conducting feature learning on a face image comprising feeding the face image into a first convolution neural network to obtain a first decision, conducting feature engineering on a face image, comprising the steps of automatically detecting facial landmarks in the face image, transforming the facial features into a two-dimensional matrix, and feeding the two-dimensional matrix into a second convolution neural network to obtain a second decision, computing a hybrid decision based on the first decision and the second decision, and recognizing a facial expression in the face image in accordance to the hybrid decision.
    Type: Grant
    Filed: March 9, 2022
    Date of Patent: October 10, 2023
    Assignee: Shutterfly, LLC
    Inventor: Leo Cyrus
  • Publication number: 20230316364
    Abstract: A computer-implemented method for creating a photo product design with minimal user inputs includes generating a first portion of a photo product design by a product design module in response to user input, determining one or more layout parameters from the user input to the first portion of the photo product design by a user design learning module, automatically creating a second portion of the photo product design by an intelligent product creation engine at least in part in response to the one or more layout parameters, and automatically making a physical photo product based on at least the first portion and the second portion of the photo product design.
    Type: Application
    Filed: April 5, 2023
    Publication date: October 5, 2023
    Applicant: Shutterfly, LLC
    Inventors: Yohann Sabbah, Eran Cohen, Elias Yossef
  • Patent number: 11763369
    Abstract: A photo design smart assistant system for reducing similar photos for display and product design includes a similarity distance computation module that can calculate hash values of images and to calculate similarity distances between the images using at least the hash values, a burst grouping module that can automatically group the images into a burst based at least in part on the similarity distances of the images, wherein at least one image is automatically selected from the burst of images, an intelligent design creation engine that can automatically create a photo product design using the selected image from the burst, and a printing and finishing facility that can automatically make a physical photo product based on the photo product design.
    Type: Grant
    Filed: August 10, 2022
    Date of Patent: September 19, 2023
    Assignee: Shutterfly, LLC
    Inventor: Omer Moshe Moussaffi
  • Patent number: 11741156
    Abstract: A method for proactively creating an image product includes capturing an image of an object in a first environment by a device, storing a library of personalized products each characterized by a product type, automatically recognizing the object in the image as having a product type associated with the library of personalized products, automatically creating a design for the personalized product of the product type using personalized content, automatically displaying the design of the personalized product of the product type incorporating the selected photo in the first environment on the device, and manufacturing a physical product based on the design of the personalized product.
    Type: Grant
    Filed: August 5, 2020
    Date of Patent: August 29, 2023
    Assignee: Shutterfly, LLC
    Inventors: Mark Levin, Vyacheslav Imeshev
  • Patent number: 11676380
    Abstract: A computer-implemented method for automatically detecting events and creating photo-product designs based on the events in a photo-product design system includes automatically identifying an event by an event detection module based on daily numbers of captured photos over a plurality of days, automatically selecting a photo-product type by an intelligent product design creation engine in the photo-product design system, calculating a daily weight for a photo product design in the photo-product type based on the daily numbers of captured photos, automatically determining a number of product photos allocated to each day based on associated daily weight, automatically selecting product photos from the captured photos each day at the event according to the number of product photos allocated to each day, and automatically creating a photo-product design for the event using the selected product photos.
    Type: Grant
    Filed: August 3, 2021
    Date of Patent: June 13, 2023
    Assignee: Shutterfly, LLC
    Inventors: Roy Amir, Nimrod Aroyo, Nadav Ribak, Yanay Hollander, Tomer Shalev
  • Publication number: 20230158603
    Abstract: A marking system for decorating one or more workpieces includes a plurality of marking stations that can mark product images on blank workpieces to produce product workpieces, at least some of which have different sizes, shapes, materials, or a combination thereof, a control system that can select one of the plurality of marking stations and send product image data to the selected one of the plurality of marking stations, and a robotic manipulator that can transport a blank workpiece to the selected marking station under the control of the robotic manipulator. The selected marking station can mark the product image the blank workpiece based on the product image data which produces a product workpiece. The robotic manipulator can remove the product workpiece from the selected one of the plurality of marking stations.
    Type: Application
    Filed: October 31, 2022
    Publication date: May 25, 2023
    Applicant: Shutterfly, LLC
    Inventors: Michael Lane Polk, David Lynn Hall
  • Patent number: 11651138
    Abstract: A method for automatically analyzing and constructing communications to a plurality of recipients includes automatically separating communication content files into page groups in a system comprising one or more intelligent communication design servers, wherein each of the page groups is associated a recipient of the communications, inputting the communication content files into an intra-page machine prediction model to produce intra-page parameters, inputting the communication content files and the intra-page parameters into an intra-page machine prediction model to produce intra-group parameters and inter-group parameters, automatically constructing standard communication design files by an intelligent communication content learning and constructing engine based on the communication content files and the intra-page parameters, intra-group parameters, and inter-group parameters, and printing and finishing physical mailing pieces to be mailed to the recipients based on the standard communication design files.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: May 16, 2023
    Assignee: Shutterfly, LLC
    Inventors: Aaron P. Reihl, Sairam Vangapally, Aaron Gregory Rasset
  • Patent number: 11651406
    Abstract: A computer-implemented method for creating a photo product design with minimal user inputs includes generating a first portion of a photo product design by a product design module in response to user input, determining one or more layout parameters from the user input to the first portion of the photo product design by a user design learning module, automatically creating a second portion of the photo product design by an intelligent product creation engine at least in part in response to the one or more layout parameters, and automatically making a physical photo product based on at least the first portion and the second portion of the photo product design.
    Type: Grant
    Filed: October 19, 2021
    Date of Patent: May 16, 2023
    Assignee: Shutterfly, LLC
    Inventors: Yohann Sabbah, Eran Cohen, Elias Yossef
  • Patent number: 11648628
    Abstract: A method for matching and tracking workpieces in laser etching operation includes generating by the computer a label image that uniquely identifies the workpiece, moving a laser head to the workpiece, setting the laser head to a first power level by a power controller, etching the product image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the first power level in accordance with a product image in a pixel wise fashion across the workpiece, moving the laser head to the label by the transport mechanism, setting the laser head to a second power level by the power controller, etching the label image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the second power level in accordance with the label image in a pixel wise fashion across the label.
    Type: Grant
    Filed: June 15, 2022
    Date of Patent: May 16, 2023
    Assignee: Shutterfly, LLC
    Inventors: David Lynn Hall, Michael Lane Polk, Gregory Lee Franklin
  • Publication number: 20230079740
    Abstract: A photo design smart assistant system for reducing similar photos for display and product design includes a similarity distance computation module that can calculate hash values of images and to calculate similarity distances between the images using at least the hash values, a burst grouping module that can automatically group the images into a burst based at least in part on the similarity distances of the images, wherein at least one image is automatically selected from the burst of images, an intelligent design creation engine that can automatically create a photo product design using the selected image from the burst, and a printing and finishing facility that can automatically make a physical photo product based on the photo product design.
    Type: Application
    Filed: August 10, 2022
    Publication date: March 16, 2023
    Applicant: Shutterfly, LLC
    Inventor: Omer Moshe Moussaffi
  • Publication number: 20230017586
    Abstract: A system for assembling a group composite image from individual subject images is described. Often subjects of a group vary in height. Additionally, as each subject is photographed individually, different zoom factors can be applied by a camera that affects a pixel density of the image captured. The system includes a fiducial marking device that emits collimated light to form one or more fiducial markers on a subject while an image is captured by the camera. Based on a location of the fiducial markers in the image, a pixel density of the image and a reference height of the subject can be determined. The individual subject image can be scaled based on the pixel density and reference height to account for the varying subject heights and zoom factors to generate a group composite image that accurately represents the subjects of the group relative to one another.
    Type: Application
    Filed: July 20, 2022
    Publication date: January 19, 2023
    Applicant: Shutterfly, LLC
    Inventors: Keith A. Benson, Brent Peterson
  • Patent number: 11524360
    Abstract: A marking system for decorating one or more workpieces includes a plurality of marking stations that can mark product images on blank workpieces to produce product workpieces, at least some of which have different sizes, shapes, materials, or a combination thereof, a control system that can select one of the plurality of marking stations and send product image data to the selected one of the plurality of marking stations, and a robotic manipulator that can transport a blank workpiece to the selected marking station under the control of the robotic manipulator. The selected marking station can mark the product image the blank workpiece based on the product image data which produces a product workpiece. The robotic manipulator can remove the product workpiece from the selected one of the plurality of marking stations.
    Type: Grant
    Filed: June 19, 2019
    Date of Patent: December 13, 2022
    Assignee: Shutterfly, LLC
    Inventors: Michael Lane Polk, David Lynn Hall
  • Publication number: 20220379407
    Abstract: A method for matching and tracking workpieces in laser etching operation includes generating by the computer a label image that uniquely identifies the workpiece, moving a laser head to the workpiece, setting the laser head to a first power level by a power controller, etching the product image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the first power level in accordance with a product image in a pixel wise fashion across the workpiece, moving the laser head to the label by the transport mechanism, setting the laser head to a second power level by the power controller, etching the label image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the second power level in accordance with the label image in a pixel wise fashion across the label.
    Type: Application
    Filed: June 15, 2022
    Publication date: December 1, 2022
    Applicant: Shutterfly, LLC
    Inventors: David Lynn Hall, Michael Lane Polk, Gregory Lee Franklin
  • Patent number: 11443469
    Abstract: A photo design smart assistant system for reducing similar photos for display and product design includes a similarity distance computation module that can calculate hash values of images and to calculate similarity distances between the images using at least the hash values, a burst grouping module that can automatically group the images into a burst based at least in part on the similarity distances of the images, wherein at least one image is automatically selected from the burst of images, an intelligent design creation engine that can automatically create a photo product design using the selected image from the burst, and a printing and finishing facility that can automatically make a physical photo product based on the photo product design.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: September 13, 2022
    Assignee: Shutterfly, LLC
    Inventor: Omer Moshe Moussaffi
  • Publication number: 20220270404
    Abstract: A computer implemented method for recognizing facial expressions by applying feature learning and feature engineering to face images. The method includes conducting feature learning on a face image comprising feeding the face image into a first convolution neural network to obtain a first decision, conducting feature engineering on a face image, comprising the steps of automatically detecting facial landmarks in the face image, transforming the facial features into a two-dimensional matrix, and feeding the two-dimensional matrix into a second convolution neural network to obtain a second decision, computing a hybrid decision based on the first decision and the second decision, and recognizing a facial expression in the face image in accordance to the hybrid decision.
    Type: Application
    Filed: March 9, 2022
    Publication date: August 25, 2022
    Applicant: Shutterfly, LLC
    Inventor: Leo Cyrus
  • Patent number: 11423558
    Abstract: A system for assembling a group composite image from individual subject images is described. Often subjects of a group vary in height. Additionally, as each subject is photographed individually, different zoom factors can be applied by a camera that affects a pixel density of the image captured. The system includes a fiducial marking device that emits collimated light to form one or more fiducial markers on a subject while an image is captured by the camera. Based on a location of the fiducial markers in the image, a pixel density of the image and a reference height of the subject can be determined. The individual subject image can be scaled based on the pixel density and reference height to account for the varying subject heights and zoom factors to generate a group composite image that accurately represents the subjects of the group relative to one another.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: August 23, 2022
    Assignee: Shutterfly, LLC
    Inventors: Keith A. Benson, Brent Peterson
  • Patent number: 11389904
    Abstract: A method for matching and tracking workpieces in laser etching operation includes generating by the computer a label image that uniquely identifies the workpiece, moving a laser head to the workpiece, setting the laser head to a first power level by a power controller, etching the product image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the first power level in accordance with a product image in a pixel wise fashion across the workpiece, moving the laser head to the label by the transport mechanism, setting the laser head to a second power level by the power controller, etching the label image on the workpiece using a laser beam emitted from the laser head, wherein the laser beam is modulated at the second power level in accordance with the label image in a pixel wise fashion across the label.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: July 19, 2022
    Assignee: Shutterfly, LLC
    Inventors: David Lynn Hall, Michael Lane Polk, Gregory Lee Franklin
  • Publication number: 20220222957
    Abstract: An automated communication design analysis and construction system includes that includes one or more intelligent communication design servers, comprising: a normalization module that converts communication content files for different recipients to normalized intermediate format files; an objects identification and quantification module that identifies text objects and image objects in the normalized intermediate format files; a cross-recipient group analysis module configured to identify static global objects that are invariant between recipients, data variables, and variable global objects that vary between recipients in the normalized intermediate format files; and an intelligent communication content learning and constructing engine that can construct standard communication design files based on the static global objects, the data variables, and the variable global objects. A data storage stores the communication content files and the standard communication design files.
    Type: Application
    Filed: January 21, 2022
    Publication date: July 14, 2022
    Applicant: Shutterfly, LLC
    Inventors: Aaron P. Reihl, Sairam Vangapally, Aaron Gregory Rasset
  • Publication number: 20220122143
    Abstract: A photo product design customization system for customizing a photo product design with minimal and intuitive user inputs includes a product design module that displays a photo product design in a main design panel, a user input detection unit that can detect a first directional movement from a first dynamic object in a product type selection panel to the main design panel, or a second directional movement from a second dynamic object in a product style selection panel to the main design panel, or a third directional movement from a third dynamic object in a product style selection panel to the main design panel, and an intelligent product design creation engine that can automatically change the photo product design in the main design panel in response to detection of the first, the second, or the third directional movement.
    Type: Application
    Filed: September 23, 2021
    Publication date: April 21, 2022
    Applicant: Shutterfly, LLC
    Inventors: Yaron Stein, Alexander M. Kenis, Roman Sandler, Yehonatan Yehudai
  • Patent number: D990566
    Type: Grant
    Filed: August 12, 2020
    Date of Patent: June 27, 2023
    Assignee: Shutterfly, LLC
    Inventors: Michael Lane Polk, Gregory Lee Franklin