Uploaded image for project: 'CFEngine Community'
  1. CFEngine Community
  2. CFE-2585

MDB_MAP_FULL error on lastseen database of a busy hub

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open
    • Priority: Medium
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: cf-serverd
    • Labels:
      None

      Description

      error: Could not commit database transaction: MDB_MAP_FULL: Environment mapsize limit reached
      

      This means that the database reached its maximum size of 100 MB. Maybe we should raise this to 2GB if am_policy_hub? Kristian Amlie what do you think?

      However filling up 100MB is excessive even for a busy hub. Here are the contents of lastseen db for each client:

      key: 0x7f00554a0ed4[16] a188.166.62.122, data: 0x7f00554a0ee4[69] SHA=2343d7b3d92ff44b19fd18c86d93000010047b67e28167bed3b8bb5284529b21
      key: 0x7f00554a0f32[70] kSHA=2343d7b3d92ff44b19fd18c86d93000010047b67e28167bed3b8bb5284529b21, data: 0x7f00554a0f78[15] 188.166.62.122
      key: 0x7f00554a0e5c[71] qiSHA=2343d7b3d92ff44b19fd18c86d93000010047b67e28167bed3b8bb5284529b21, data: 0x7f00554a0ea3[40] WܢX
      key: 0x7f00554a0f90[71] qoSHA=2343d7b3d92ff44b19fd18c86d93000010047b67e28167bed3b8bb5284529b21, data: 0x7f00554a0fd7[40] WܢX
      

      Adding up the sizes of all keys and values I'm counting 392 bytes per client.

      If we round this up to 400B, then a full 100MB database can hold 256K clients! This should be enough for everyone.

      One reason for lastseen db to constantly grow would be incoming connections from new keys or new IPs all the time.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                a10038 jimis (Dimitrios Apostolou)
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel