Re: CI, macports, darwin version problems

From: Nazir Bilal Yavuz <byavuz81(at)gmail(dot)com>
To: Joe Conway <mail(at)joeconway(dot)com>
Cc: Thomas Munro <thomas(dot)munro(at)gmail(dot)com>, Andres Freund <andres(at)anarazel(dot)de>, Tom Lane <tgl(at)sss(dot)pgh(dot)pa(dot)us>, pgsql-hackers <pgsql-hackers(at)postgresql(dot)org>, Christophe Pettus <christophe(dot)pettus(at)pgexperts(dot)com>
Subject: Re: CI, macports, darwin version problems
Date: 2024-07-18 14:23:01
Message-ID: CAN55FZ3wMpz5tMKNYqN-BLGTRYcE8=y=+7Zt4arvffY+CdF03w@mail.gmail.com
Views: Raw Message | Whole Thread | Download mbox | Resend email
Thread:
Lists: pgsql-hackers

Hi,

On Thu, 18 Jul 2024 at 17:01, Joe Conway <mail(at)joeconway(dot)com> wrote:
>
> On 7/18/24 08:55, Nazir Bilal Yavuz wrote:
> > Hi,
> >
> > On Thu, 18 Jul 2024 at 15:00, Joe Conway <mail(at)joeconway(dot)com> wrote:
> >>
> >> On 7/18/24 07:55, Joe Conway wrote:
> >> > On 7/18/24 04:12, Nazir Bilal Yavuz wrote:
> >> >> Could it be pulling the ''macos-runner:sonoma' image on every run?
> >> >
> >> > Or perhaps since this was the first run it simply needed to pull the
> >> > image for the first time?
> >
> > It was not the first run, Thomas rerun it a couple of times but all of
> > them were in the same build. So, I thought that CI may set some
> > settings to pull the image while starting the build, so it
> > re-downloads the image for all the tasks in the same build. But that
> > looks wrong because of what you said below.
> >
> >> >
> >> > The scheduling timing (21:24) looks a lot like what I observed when I
> >> > did the test for the time to download. Unfortunately I did not time the
> >> > test though.
> >>
> >> Actually it does look like the image is gone now based on the free space
> >> on the volume, so maybe it is pulling every run and cleaning up rather
> >> than caching for some reason?
> >>
> >> Filesystem Size Used Avail Capacity
> >> /dev/disk3s5 228Gi 39Gi 161Gi 20%
> >
> > That is interesting. Only one thing comes to my mind. It seems that
> > the 'tart prune' command runs automatically to reclaim space when
> > there is no space left and thinks it can reclaim the space by removing
> > some things [1]. So, it could be that somehow 'tart prune' ran
> > automatically and deleted the sonoma image. I think you can check if
> > this is the case. You can check these locations [2] from ci-user to
> > see when ventura images are created. If they have been created less
> > than 1 day ago, I think the current space is not enough to pull both
> > ventura and sonoma images.
>
> I think you nailed it (this will wrap badly):
> 8<-----------------
> macmini:~ ci-run$ ll ~/.tart/cache/OCIs/ghcr.io/cirruslabs/*
> /Users/ci-run/.tart/cache/OCIs/ghcr.io/cirruslabs/macos-runner:
> total 0
> drwxr-xr-x 2 ci-run staff 64 Jul 17 23:53 .
> drwxr-xr-x 5 ci-run staff 160 Jul 17 17:16 ..
>
> /Users/ci-run/.tart/cache/OCIs/ghcr.io/cirruslabs/macos-sonoma-base:
> total 0
> drwxr-xr-x 2 ci-run staff 64 Jul 17 13:18 .
> drwxr-xr-x 5 ci-run staff 160 Jul 17 17:16 ..
>
> /Users/ci-run/.tart/cache/OCIs/ghcr.io/cirruslabs/macos-ventura-base:
> total 0
> drwxr-xr-x 4 ci-run staff 128 Jul 17 23:53 .
> drwxr-xr-x 5 ci-run staff 160 Jul 17 17:16 ..
> lrwxr-xr-x 1 ci-run staff 140 Jul 17 23:53 latest ->
> /Users/ci-run/.tart/cache/OCIs/ghcr.io/cirruslabs/macos-ventura-base/sha256:bddfa1e2b6f6ec41b5db844b06a6784a2bffe0b071965470efebd95ea3355b4f
> drwxr-xr-x 5 ci-run staff 160 Jul 17 23:53
> sha256:bddfa1e2b6f6ec41b5db844b06a6784a2bffe0b071965470efebd95ea3355b4f
> 8<-----------------
>
> So perhaps I am back to needing more storage...

You might not need more storage. Thomas knows better, but AFAIU, CFBot
will pull only sonoma images after the patch in this thread gets
merged. And your storage seems enough for storing it.

--
Regards,
Nazir Bilal Yavuz
Microsoft

In response to

Responses

Browse pgsql-hackers by date

  From Date Subject
Next Message Richard Guo 2024-07-18 14:30:22 Re: Should consider materializing the cheapest inner path in consider_parallel_nestloop()
Previous Message Joe Conway 2024-07-18 14:01:44 Re: CI, macports, darwin version problems