SlideShare a Scribd company logo
1 of 46
Download to read offline
National Aeronautics and Space
Administration
Jet Propulsion Laboratory
California Institute of Technology




                    Market-Based Systems:
                    Bidding your way to the
                         Launch Pad

                                         Dr. Randii R. Wessen
                                              Jet Propulsion Laboratory
                                           California Institute of Technology
                                              Dr. Dave Porter
                                     Interdisciplinary Center for Economic Science
                                                George Mason University


                                                                                     1
Agenda


• Introduction
• Cassini Science Instrument Development
• Space Shuttle Manifests
• LightSAR Mission Planning
• Market-Based Systems Applied to NASA
  Resource Allocation Problems
• Conclusions



                                           2
Introduction

Problem - How to allocate scarce resources
among many users?
♦   Users do not have an incentive to reveal accurate information.
Current Approach:
♦ Benevolent Dictator - Impartial individual making decisions for
  user community.
♦ Committee - “Consensus” reached by user representatives.

New Approach:
♦   Market-based systems - Decentralized incentive-based
    decision-making at the user level.



                                                                     3
Introduction (cont.)

Market-based systems use “rights” and
“trades” to resolve conflicts.
 ♦ Users:
   – Own clearly defined resources.
   – Decide the importance of their resources.
   – Enhance their own position by exchanging resources
     among themselves.




                                                          4
Introduction (cont.)

Market-based systems require that an
“economy” be created.
To create an economy, the following must be
defined:
♦ Resources to be allocated.
♦ Resource ownership rights.
♦ Rules for making and keeping track of trades.




                                                  5
Introduction (cont.)

Market-based systems have two major
phases:
♦ Initial Allocation (Primary Market) - Users use “currency” to
  establish property rights over resources.
♦ Aftermarket (Secondary Market) - Users can voluntarily
  trade their resources with others to enhance their value.




                                                                  6
Introduction (cont.)

Examples of Market-based systems used in
private industry:
    ♦ Best Buy           ♦ RECLAIM Program in
    ♦ Corning              Southern California
    ♦ Federal            ♦ Sandia National
      Communications       Laboratories
      Commission         ♦ Sears Logistic Services
    ♦ General Electric   ♦ University of Chicago
    ♦ Google               Business School
    ♦ Hewlett-Packard    ♦ University of Michigan
    ♦ Koch Industries    ♦ University of San Diego
    ♦ Microsoft


                                                     7
The Cassini Instrument
     Development



                         8
Cassini Instrument Development

Typical instrument development for planetary
missions require:
 ♦ Project’s to submit a Request for Proposals.
 ♦ Project’s acceptance of Principal Investigators’ proposals.

Data from previous missions show that
instrument mass and cost growths are:
 ♦ Almost always positive.
 ♦ Can be very large.




                                                                 9
Cassini Instrument Dev. (cont.)

     Percent Growth for Past Space Missions




                                              10
Cassini Instrument Dev. (cont.)

In 1992 a Market-based Aftermarket, known
as the Cassini Resource Exchange (CRE),
was developed.
♦   Based on experiments conducted at Caltech with student
    subjects and science personnel.
Instrument mass, power, data rate, and
funding were allowed to be traded.
♦   The CRE opened in 1993 and closed in 1995.
     – 29 successful trades were made, all but two involved
       money and mass.



                                                              11
Cassini Instrument Dev. (cont.)

Example of a money-market trade:
 $200k this FY in return for $212k next FY = 6%.

16 contracts, worth $4M, were traded at an
average rate of 8.5%.
                              Fig 2. Money Market Activity
           14
                                                                                Cassini Trade
           12                                                                   1 Year T-Bill

           10

            8
  % Rate




            6

            4

            2

            0

                0   20   40     60      80       100       120      140   160     180           200

                                     Week Number Starting in FY93
                                                                                                      12
Cassini Instrument Dev. (cont.)

Mass-market trades:
♦ Mass started at $105k/kg and fell to $5k/kg.
♦ 11 contracts for a total of 12 kg were traded.


                       Figure 5: Mass Market Activity


            120

            100

             80
    $k/Kg




             60

             40

             20

              0

                  0   50               100                150   200

                           Week Number Starting in FY93

                                                                      13
Cassini Instrument Dev. (cont.)

Cost for the entire science payload grew by
<1%.
                                    Figure 6: Cassini's Instrument Cost Growth


                      60



                      50



                      40
            ost, $M




                                                                                                    LOA Cost
                      30
      otal C




                                                                                                    Final Cost
     T




                      20



                      10



                       0
                                                                    R


                                                                            S
                        PS




                                                                                                S
                                             S




                                                         G




                                                                                        IS
                               A


                                      S




                                                                                  S
                                                                I
                                                   S




                                                              IM


                                                                   A


                                                                           W
                                            M




                                                                                              IM
                                    IR




                                                        A




                                                                                RS
                                                 IS
                              D




                                                                                       V
                       A




                                                                  D
                                                             M
                                          IN




                                                       M
                             C


                                   C




                                                                         RP




                                                                                      U


                                                                                             V
                      C




                                                                RA




                                                        Investigations




                                                                                                                 14
Cassini Instrument Dev. (cont.)

Mass for the entire science payload decreased by
7%.                              Figure 7: Cassini's Instrument Mass Growth


                   70


                   60


                   50


                   40
        ass, kg.




                                                                                                 LOA Mass
                                                                                                 Final Mass
                   30
       M




                   20


                   10


                    0
                                                                 R


                                                                         S
                     PS




                                                                                             S
                                          S




                                                      G




                                                                                     IS
                            A


                                   S




                                                                               S
                                                             I
                                                S




                                                           IM


                                                                A


                                                                        W
                                         M




                                                                                           IM
                                 IR




                                                     A




                                                                             RS
                                              IS
                           D




                                                                                    V
                    A




                                                               D
                                                          M
                                       IN




                                                    M
                          C


                                C




                                                                      RP




                                                                                   U


                                                                                          V
                   C




                                                             RA




                                                     Investigations




                                                                                                              15
Cassini Instrument Dev. (cont.)

In 1998 a Market-based system was developed
for Cassini science planning.
♦ Web-based application.
    – Password protected.
♦ Used to allocate observation time, CDS words and data volume.
♦ Compatible with JPL’s Mission Sequence Software System
  (e.g., APGEN)




                                                                  16
Cassini Instrument Dev. (cont.)

 Cassini science planning bid sheet.




                                       17
Cassini Instrument Dev. (cont.)

• Cassini Science
  Planning Tool.
  ♦   Timeline is always
      conflict-free.
  ♦   Provides user
      feedback to get
      observation
      requests accepted.
  ♦   This system was
      never tested.




                                     18
Space Shuttle
    Manifests of
Secondary Payloads



                     19
Space Shuttle Manifests

Typical approach for manifesting Space
Shuttles Secondary Payloads require:
♦ NASA User Codes to submit requests for payload lockers.
♦ Manifestors at NASA Headquarters allocate lockers in such
  a way to:
   – Utilize Space Shuttle resources to capacity.
   – Be “fair” to the User Codes.




                                                              20
Space Shuttle Manifests (cont.)


 Multiple meetings required to:
 ♦ Present current manifest.
 ♦ Explain why some payloads were included while others
   were not.
 ♦ Obtain payload trade-off information.

 Manifestors required to re-manifest
 secondary payloads after each meeting.




                                                          21
Space Shuttle Manifests (cont.)


In the summer of 1996 a Market-based Initial
Allocation experiment was developed for
NASA’s Office of Space Utilization.
♦ Market-based approach was compared to a simple ranking
  approach.
♦ Secondary payload lockers, energy, and crew hour
  requirements were allowed to be requested.




                                                           22
Space Shuttle Manifests (cont.)

  Office of Space Utilization personnel performed
  the simple ranking manifest.
   ♦    Results were compared to market-based results.
  Real payload data was used.
   ♦    A “science return” value and payload rank were included to
        measure the caliber of the manifest.
 USER        P/L      LOCKERS   WATT-HRS   CREW-HRS   SCIENCE RETURN   RANK
Code U    MGBX-01        6        237        56           100           1
Code U    CGBA-04        4        136       5.166          70           2
Code U     CPCG-07       1        128       5.833          55           2
Code U     CPCG-08       1        128         2            45           3
Code U PCG-TES-02        3        115         0            40           3

                                                                              23
Space Shuttle Manifests (cont.)

 Comparison of resource utilization between a
simple ranking vs a market-based approach.
                                                                       Ranking
                                                                       Manual
                                     Resource Utilization              MBS
                                                                       Points


                     100
% of Capacity Used




                      95

                      90

                      85

                      80

                      75
                           Lockers          Watt-Hrs        Crew-Hrs
                                                                                 24
Space Shuttle Manifests (cont.)

      Comparison of science value for a simple ranking
     vs a market-based approach.
                                           Additional Science Return Relative to Baseline
                            40                                                       Year 1
                                                                                     Year 2
                            30                                                       Total
          % Excess Return




                            20
                            10
                             0
                            -10
                            -20
                            -30
                                  Code U    Code S     Code X     Code F       DoD
Point carry-over                    0         37         30          3               1
Year 1 to Year 2
                                                                                              25
Space Shuttle Manifests (cont.)

Market-based systems have already handled
the following type of problem:
♦   Manifest space shuttles middeck lockers efficiently
♦   6 Users
♦   47 variables/payload
♦   1,500,000 payload requests
♦   Solutions found in an average of 2.5 minutes




                                                          26
Space Shuttle Manifests (cont.)


Implementation of a market-based system is
“on-hold” until:
♦   The full impact of the International Space Station’s
    requirements on middeck lockers can be determined.
♦   “Nominal” Space Shuttle missions resume.




                                                           27
LightSAR
Mission Planning



                   28
LightSAR Mission Planning

LightSAR was a NASA initiative to develop a
low-cost Earth-imaging RADAR satellite.
Typical approach for mission planning:
♦ Submit data take requests.
♦ Create integrated timeline.
♦ Multiple meetings to resolve conflicts.
♦ Re-Integrate timeline.




                                              29
LightSAR Mission Planning (cont.)

In the winter of 1997 a Market-based Initial
Allocation experiment was developed for
LightSAR mission planning.
 ♦   Users were assigned a specific data acquisition type (e.g.
     Hi-Res Strip, Spotlight, Interferometry, Dual Polarimetry,
     etc.).




                                                                  30
LightSAR Mission Planning (cont.)

A data request, rank and “science return”
value were included with each request to
measure the caliber of the manifest.
                 Dual Polarimetry Requests
    Location        Orbit    Data Take       Rank   Value
                  Number     Number

    Vietnam          1           1            1      60
  Kuala Lumpar       1           3            2      45
    Indonesia        1           4            2      35
    Cambodia         2           3            3      10




                                                            31
LightSAR Mission Planning (cont.)

In a market-based approach, Users bid for a
“higher priority” request.
 ♦ The higher the priority, the greater the probability of
   getting into the timeline.
 ♦ A Vickrey Auction was used to provide “incentives” for the
   Users to be forthright about their bids.
    – In a Vickrey Auction “winners”pay the runner-up price.




                                                                32
LightSAR Mission Planning (cont.)

    Comparison of the science value between a
    simple ranking, a simple market, and a market
    using a Vickrey Auction.
                                                                       Science Values

                                       108                                                       Simple Market
                                                                                                 Simple Market
                                                                                                 Priority Marke
                                                                                                 Market w/ Vickrey
                                       107
                                       106
                  % of Draft Outcome




                                       105
                                       104
                                       103
                                       102
                                       101
Science value using
a simple ranking                       100
approach
                                       99
                                             Subject 1   Subject 2   Subject 3   Subject 4   Cumulative

                                                                                                                     33
LightSAR Mission Planning (cont.)




                                    34
LightSAR Mission Planning (cont.)




                                    35
LightSAR Mission Planning (cont.)




                                    36
LightSAR Mission Planning (cont.)




                                    37
LightSAR Mission Planning (cont.)

Experiments revealed only minor operational
problems.
 ♦ Lack of experience seemed to be the largest.

LightSAR was canceled.
A new RADAR mission called INSAR has begun
concept studies.
♦   The work on LightSAR can be used for INSAR and will be
    pursued.



                                                             38
Market-Based Systems
Applied to NASA Resource
   Allocation Problems



                           39
NASA Market-Based Systems

      Task             Start         End                   Status
Cassini Instrument                              Successfully controlled mass and
                      1993 Sept    1995 April
Development                                     cost growth.
Space Shuttle
                      1996 Dec     1997 Sept    Never made it past experiments.
Manifests
LightSAR Mission
                      1997 Dec     1998 Sept    Mission canceled.
Planning
Cassini Science                                 Never performed experiments
                      1998 April   1999 Mar
Planning                                        with users.
Mars’01 Science
                      1999 April   1999 Dec     Mission canceled.
Planning
International Space                             Never performed experiments
                      2000 Sept    On Hold
Station Manifests                               with users.
Alternate Workforce                             Never performed experiments
                      2000 Jun     2002 Jan
Allocations                                     with users.

Deep Space Network                              Never performed experiments
                      2005 Jan     2005 April
Antenna Allocation                              with users.



                                                                                   40
Conclusions




              41
Conclusions

Cassini, Space Shuttle, and LightSAR
benefited (or could benefit) from the use of a
market-based process.
Resource allocation problems can be solved
with the use of market-based systems.
♦   Data shows that market-based systems can produce results:
     – As good (or better) than the current processes.
     – Are reached quicker and with a smaller workforce.




                                                                42
Conclusions

The strengths of market-based systems are
that they:
♦ Move the decision making process back to the individuals
  that have the information, namely the users.
♦ Are electronically based on the Web and thus can be
  globally distributed.
♦ Remove the need for multiple meetings and appeals.




                                                             43
Conclusions

One perceived short coming of market-based
systems is their initial allocation.
♦ However, all processes have initial allocation problems.
♦ Better to solve one large problem early then multiple smaller
  problems late in a given process.
Most individuals outside of experimental
economics do not appreciate the power of
market-based systems.



                                                                  44
Conclusions

In order to successfully implement a market-
based system it is recommended that it be
used in parallel with the current approach to
“gently” help users understand its application.
There will be resistance to change to a new
system, even a more efficient one.
♦ Winners are not sure that they’ll do as well as compared to
  the current process.
♦ Losers are not sure that they’ll do better as compared to the
  current process.
♦ Integrators lose their jobs.
♦ Managers will express a loss of control.

                                                                  45
Conclusions

Top 5 “bad” reasons for not using a market-
based system:
5. “Market-based systems can solve resource allocation problems,
   but my problem is different.”
4. “We don’t have a resource allocation problem, we just just have
   a scheduling problem.”
3. “There’s no way to come up with an initial allocation of
   resources.”
2. “Too many people will lose their jobs.”
1. “We don’t need a market-based system to solve our problems.
   We’ll just solve it in a collegial manner.”


                                                                     46

More Related Content

Viewers also liked

Paradis william
Paradis williamParadis william
Paradis williamNASAPMC
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mikeNASAPMC
 
O'keefe william
O'keefe williamO'keefe william
O'keefe williamNASAPMC
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski johnNASAPMC
 
Rackley mike
Rackley mikeRackley mike
Rackley mikeNASAPMC
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joeNASAPMC
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuartNASAPMC
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandraNASAPMC
 
Law.richard
Law.richardLaw.richard
Law.richardNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Seftas krage
Seftas krageSeftas krage
Seftas krageNASAPMC
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marcoNASAPMC
 
Mc namara.karen
Mc namara.karenMc namara.karen
Mc namara.karenNASAPMC
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karleneNASAPMC
 
Snow lee
Snow leeSnow lee
Snow leeNASAPMC
 
Yew manson
Yew mansonYew manson
Yew mansonNASAPMC
 
Wood frank
Wood frankWood frank
Wood frankNASAPMC
 
Humphreys.gary
Humphreys.garyHumphreys.gary
Humphreys.garyNASAPMC
 
Muller ralf
Muller ralfMuller ralf
Muller ralfNASAPMC
 
Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk boNASAPMC
 

Viewers also liked (20)

Paradis william
Paradis williamParadis william
Paradis william
 
Rudolphi mike
Rudolphi mikeRudolphi mike
Rudolphi mike
 
O'keefe william
O'keefe williamO'keefe william
O'keefe william
 
Baniszewski john
Baniszewski johnBaniszewski john
Baniszewski john
 
Rackley mike
Rackley mikeRackley mike
Rackley mike
 
Vellinga joe
Vellinga joeVellinga joe
Vellinga joe
 
Trahan stuart
Trahan stuartTrahan stuart
Trahan stuart
 
Smalley sandra
Smalley sandraSmalley sandra
Smalley sandra
 
Law.richard
Law.richardLaw.richard
Law.richard
 
Wood frank
Wood frankWood frank
Wood frank
 
Seftas krage
Seftas krageSeftas krage
Seftas krage
 
Sampietro marco
Sampietro marcoSampietro marco
Sampietro marco
 
Mc namara.karen
Mc namara.karenMc namara.karen
Mc namara.karen
 
Roberts karlene
Roberts karleneRoberts karlene
Roberts karlene
 
Snow lee
Snow leeSnow lee
Snow lee
 
Yew manson
Yew mansonYew manson
Yew manson
 
Wood frank
Wood frankWood frank
Wood frank
 
Humphreys.gary
Humphreys.garyHumphreys.gary
Humphreys.gary
 
Muller ralf
Muller ralfMuller ralf
Muller ralf
 
Bejmuk bo
Bejmuk boBejmuk bo
Bejmuk bo
 

More from NASAPMC

Mulenburg jerry
Mulenburg jerryMulenburg jerry
Mulenburg jerryNASAPMC
 
Mitskevich amanda
Mitskevich amandaMitskevich amanda
Mitskevich amandaNASAPMC
 
Martt anne
Martt anneMartt anne
Martt anneNASAPMC
 
Manzer fred
Manzer fredManzer fred
Manzer fredNASAPMC
 
Manthos jeff
Manthos jeffManthos jeff
Manthos jeffNASAPMC
 
Lengyel dave
Lengyel daveLengyel dave
Lengyel daveNASAPMC
 
Krahula john
Krahula johnKrahula john
Krahula johnNASAPMC
 
Kroeger lin
Kroeger linKroeger lin
Kroeger linNASAPMC
 
Krage jousha
Krage joushaKrage jousha
Krage joushaNASAPMC
 
Kotnour tim
Kotnour timKotnour tim
Kotnour timNASAPMC
 
King richardson
King richardsonKing richardson
King richardsonNASAPMC
 

More from NASAPMC (11)

Mulenburg jerry
Mulenburg jerryMulenburg jerry
Mulenburg jerry
 
Mitskevich amanda
Mitskevich amandaMitskevich amanda
Mitskevich amanda
 
Martt anne
Martt anneMartt anne
Martt anne
 
Manzer fred
Manzer fredManzer fred
Manzer fred
 
Manthos jeff
Manthos jeffManthos jeff
Manthos jeff
 
Lengyel dave
Lengyel daveLengyel dave
Lengyel dave
 
Krahula john
Krahula johnKrahula john
Krahula john
 
Kroeger lin
Kroeger linKroeger lin
Kroeger lin
 
Krage jousha
Krage joushaKrage jousha
Krage jousha
 
Kotnour tim
Kotnour timKotnour tim
Kotnour tim
 
King richardson
King richardsonKing richardson
King richardson
 

Recently uploaded

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 

Recently uploaded (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 

Wessen randi (cd)

  • 1. National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Market-Based Systems: Bidding your way to the Launch Pad Dr. Randii R. Wessen Jet Propulsion Laboratory California Institute of Technology Dr. Dave Porter Interdisciplinary Center for Economic Science George Mason University 1
  • 2. Agenda • Introduction • Cassini Science Instrument Development • Space Shuttle Manifests • LightSAR Mission Planning • Market-Based Systems Applied to NASA Resource Allocation Problems • Conclusions 2
  • 3. Introduction Problem - How to allocate scarce resources among many users? ♦ Users do not have an incentive to reveal accurate information. Current Approach: ♦ Benevolent Dictator - Impartial individual making decisions for user community. ♦ Committee - “Consensus” reached by user representatives. New Approach: ♦ Market-based systems - Decentralized incentive-based decision-making at the user level. 3
  • 4. Introduction (cont.) Market-based systems use “rights” and “trades” to resolve conflicts. ♦ Users: – Own clearly defined resources. – Decide the importance of their resources. – Enhance their own position by exchanging resources among themselves. 4
  • 5. Introduction (cont.) Market-based systems require that an “economy” be created. To create an economy, the following must be defined: ♦ Resources to be allocated. ♦ Resource ownership rights. ♦ Rules for making and keeping track of trades. 5
  • 6. Introduction (cont.) Market-based systems have two major phases: ♦ Initial Allocation (Primary Market) - Users use “currency” to establish property rights over resources. ♦ Aftermarket (Secondary Market) - Users can voluntarily trade their resources with others to enhance their value. 6
  • 7. Introduction (cont.) Examples of Market-based systems used in private industry: ♦ Best Buy ♦ RECLAIM Program in ♦ Corning Southern California ♦ Federal ♦ Sandia National Communications Laboratories Commission ♦ Sears Logistic Services ♦ General Electric ♦ University of Chicago ♦ Google Business School ♦ Hewlett-Packard ♦ University of Michigan ♦ Koch Industries ♦ University of San Diego ♦ Microsoft 7
  • 8. The Cassini Instrument Development 8
  • 9. Cassini Instrument Development Typical instrument development for planetary missions require: ♦ Project’s to submit a Request for Proposals. ♦ Project’s acceptance of Principal Investigators’ proposals. Data from previous missions show that instrument mass and cost growths are: ♦ Almost always positive. ♦ Can be very large. 9
  • 10. Cassini Instrument Dev. (cont.) Percent Growth for Past Space Missions 10
  • 11. Cassini Instrument Dev. (cont.) In 1992 a Market-based Aftermarket, known as the Cassini Resource Exchange (CRE), was developed. ♦ Based on experiments conducted at Caltech with student subjects and science personnel. Instrument mass, power, data rate, and funding were allowed to be traded. ♦ The CRE opened in 1993 and closed in 1995. – 29 successful trades were made, all but two involved money and mass. 11
  • 12. Cassini Instrument Dev. (cont.) Example of a money-market trade: $200k this FY in return for $212k next FY = 6%. 16 contracts, worth $4M, were traded at an average rate of 8.5%. Fig 2. Money Market Activity 14 Cassini Trade 12 1 Year T-Bill 10 8 % Rate 6 4 2 0 0 20 40 60 80 100 120 140 160 180 200 Week Number Starting in FY93 12
  • 13. Cassini Instrument Dev. (cont.) Mass-market trades: ♦ Mass started at $105k/kg and fell to $5k/kg. ♦ 11 contracts for a total of 12 kg were traded. Figure 5: Mass Market Activity 120 100 80 $k/Kg 60 40 20 0 0 50 100 150 200 Week Number Starting in FY93 13
  • 14. Cassini Instrument Dev. (cont.) Cost for the entire science payload grew by <1%. Figure 6: Cassini's Instrument Cost Growth 60 50 40 ost, $M LOA Cost 30 otal C Final Cost T 20 10 0 R S PS S S G IS A S S I S IM A W M IM IR A RS IS D V A D M IN M C C RP U V C RA Investigations 14
  • 15. Cassini Instrument Dev. (cont.) Mass for the entire science payload decreased by 7%. Figure 7: Cassini's Instrument Mass Growth 70 60 50 40 ass, kg. LOA Mass Final Mass 30 M 20 10 0 R S PS S S G IS A S S I S IM A W M IM IR A RS IS D V A D M IN M C C RP U V C RA Investigations 15
  • 16. Cassini Instrument Dev. (cont.) In 1998 a Market-based system was developed for Cassini science planning. ♦ Web-based application. – Password protected. ♦ Used to allocate observation time, CDS words and data volume. ♦ Compatible with JPL’s Mission Sequence Software System (e.g., APGEN) 16
  • 17. Cassini Instrument Dev. (cont.) Cassini science planning bid sheet. 17
  • 18. Cassini Instrument Dev. (cont.) • Cassini Science Planning Tool. ♦ Timeline is always conflict-free. ♦ Provides user feedback to get observation requests accepted. ♦ This system was never tested. 18
  • 19. Space Shuttle Manifests of Secondary Payloads 19
  • 20. Space Shuttle Manifests Typical approach for manifesting Space Shuttles Secondary Payloads require: ♦ NASA User Codes to submit requests for payload lockers. ♦ Manifestors at NASA Headquarters allocate lockers in such a way to: – Utilize Space Shuttle resources to capacity. – Be “fair” to the User Codes. 20
  • 21. Space Shuttle Manifests (cont.) Multiple meetings required to: ♦ Present current manifest. ♦ Explain why some payloads were included while others were not. ♦ Obtain payload trade-off information. Manifestors required to re-manifest secondary payloads after each meeting. 21
  • 22. Space Shuttle Manifests (cont.) In the summer of 1996 a Market-based Initial Allocation experiment was developed for NASA’s Office of Space Utilization. ♦ Market-based approach was compared to a simple ranking approach. ♦ Secondary payload lockers, energy, and crew hour requirements were allowed to be requested. 22
  • 23. Space Shuttle Manifests (cont.) Office of Space Utilization personnel performed the simple ranking manifest. ♦ Results were compared to market-based results. Real payload data was used. ♦ A “science return” value and payload rank were included to measure the caliber of the manifest. USER P/L LOCKERS WATT-HRS CREW-HRS SCIENCE RETURN RANK Code U MGBX-01 6 237 56 100 1 Code U CGBA-04 4 136 5.166 70 2 Code U CPCG-07 1 128 5.833 55 2 Code U CPCG-08 1 128 2 45 3 Code U PCG-TES-02 3 115 0 40 3 23
  • 24. Space Shuttle Manifests (cont.) Comparison of resource utilization between a simple ranking vs a market-based approach. Ranking Manual Resource Utilization MBS Points 100 % of Capacity Used 95 90 85 80 75 Lockers Watt-Hrs Crew-Hrs 24
  • 25. Space Shuttle Manifests (cont.) Comparison of science value for a simple ranking vs a market-based approach. Additional Science Return Relative to Baseline 40 Year 1 Year 2 30 Total % Excess Return 20 10 0 -10 -20 -30 Code U Code S Code X Code F DoD Point carry-over 0 37 30 3 1 Year 1 to Year 2 25
  • 26. Space Shuttle Manifests (cont.) Market-based systems have already handled the following type of problem: ♦ Manifest space shuttles middeck lockers efficiently ♦ 6 Users ♦ 47 variables/payload ♦ 1,500,000 payload requests ♦ Solutions found in an average of 2.5 minutes 26
  • 27. Space Shuttle Manifests (cont.) Implementation of a market-based system is “on-hold” until: ♦ The full impact of the International Space Station’s requirements on middeck lockers can be determined. ♦ “Nominal” Space Shuttle missions resume. 27
  • 29. LightSAR Mission Planning LightSAR was a NASA initiative to develop a low-cost Earth-imaging RADAR satellite. Typical approach for mission planning: ♦ Submit data take requests. ♦ Create integrated timeline. ♦ Multiple meetings to resolve conflicts. ♦ Re-Integrate timeline. 29
  • 30. LightSAR Mission Planning (cont.) In the winter of 1997 a Market-based Initial Allocation experiment was developed for LightSAR mission planning. ♦ Users were assigned a specific data acquisition type (e.g. Hi-Res Strip, Spotlight, Interferometry, Dual Polarimetry, etc.). 30
  • 31. LightSAR Mission Planning (cont.) A data request, rank and “science return” value were included with each request to measure the caliber of the manifest. Dual Polarimetry Requests Location Orbit Data Take Rank Value Number Number Vietnam 1 1 1 60 Kuala Lumpar 1 3 2 45 Indonesia 1 4 2 35 Cambodia 2 3 3 10 31
  • 32. LightSAR Mission Planning (cont.) In a market-based approach, Users bid for a “higher priority” request. ♦ The higher the priority, the greater the probability of getting into the timeline. ♦ A Vickrey Auction was used to provide “incentives” for the Users to be forthright about their bids. – In a Vickrey Auction “winners”pay the runner-up price. 32
  • 33. LightSAR Mission Planning (cont.) Comparison of the science value between a simple ranking, a simple market, and a market using a Vickrey Auction. Science Values 108 Simple Market Simple Market Priority Marke Market w/ Vickrey 107 106 % of Draft Outcome 105 104 103 102 101 Science value using a simple ranking 100 approach 99 Subject 1 Subject 2 Subject 3 Subject 4 Cumulative 33
  • 38. LightSAR Mission Planning (cont.) Experiments revealed only minor operational problems. ♦ Lack of experience seemed to be the largest. LightSAR was canceled. A new RADAR mission called INSAR has begun concept studies. ♦ The work on LightSAR can be used for INSAR and will be pursued. 38
  • 39. Market-Based Systems Applied to NASA Resource Allocation Problems 39
  • 40. NASA Market-Based Systems Task Start End Status Cassini Instrument Successfully controlled mass and 1993 Sept 1995 April Development cost growth. Space Shuttle 1996 Dec 1997 Sept Never made it past experiments. Manifests LightSAR Mission 1997 Dec 1998 Sept Mission canceled. Planning Cassini Science Never performed experiments 1998 April 1999 Mar Planning with users. Mars’01 Science 1999 April 1999 Dec Mission canceled. Planning International Space Never performed experiments 2000 Sept On Hold Station Manifests with users. Alternate Workforce Never performed experiments 2000 Jun 2002 Jan Allocations with users. Deep Space Network Never performed experiments 2005 Jan 2005 April Antenna Allocation with users. 40
  • 42. Conclusions Cassini, Space Shuttle, and LightSAR benefited (or could benefit) from the use of a market-based process. Resource allocation problems can be solved with the use of market-based systems. ♦ Data shows that market-based systems can produce results: – As good (or better) than the current processes. – Are reached quicker and with a smaller workforce. 42
  • 43. Conclusions The strengths of market-based systems are that they: ♦ Move the decision making process back to the individuals that have the information, namely the users. ♦ Are electronically based on the Web and thus can be globally distributed. ♦ Remove the need for multiple meetings and appeals. 43
  • 44. Conclusions One perceived short coming of market-based systems is their initial allocation. ♦ However, all processes have initial allocation problems. ♦ Better to solve one large problem early then multiple smaller problems late in a given process. Most individuals outside of experimental economics do not appreciate the power of market-based systems. 44
  • 45. Conclusions In order to successfully implement a market- based system it is recommended that it be used in parallel with the current approach to “gently” help users understand its application. There will be resistance to change to a new system, even a more efficient one. ♦ Winners are not sure that they’ll do as well as compared to the current process. ♦ Losers are not sure that they’ll do better as compared to the current process. ♦ Integrators lose their jobs. ♦ Managers will express a loss of control. 45
  • 46. Conclusions Top 5 “bad” reasons for not using a market- based system: 5. “Market-based systems can solve resource allocation problems, but my problem is different.” 4. “We don’t have a resource allocation problem, we just just have a scheduling problem.” 3. “There’s no way to come up with an initial allocation of resources.” 2. “Too many people will lose their jobs.” 1. “We don’t need a market-based system to solve our problems. We’ll just solve it in a collegial manner.” 46