#6517 [BUG] Attribute access on dataclasses is not reproducible on remote causing cache misses
Issue created by
ggydush
### Flyte & Flytekit version
flytekit==1.16.1
### Describe the bug
Attribute access on dataclasses is not reproducible on remote executions (local executions do not have this problem). I've included an example workflow below which has a similar structure to one of our more complex workflows that has this issue.
Execution 1 (writes to cache):
[Image](https://private-user-images.githubusercontent.com/35151789/461165426-5cd9779f-54ff-4a86-8d98-71aa20eb4235.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTEzOTA4MzIsIm5iZiI6MTc1MTM5MDUzMiwicGF0aCI6Ii8zNTE1MTc4OS80NjExNjU0MjYtNWNkOTc3OWYtNTRmZi00YTg2LThkOTgtNzFhYTIwZWI0MjM1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA3MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNzAxVDE3MjIxMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTJmNjk2MWE1N2EwMmY5OGM3NDdiMWY2ZjE5ZDhjZjlmOTdlNGY3OWZiZDIzZTlhOTVhYzcwYzRlYTQ0MTM4ZmImWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.ImMk1h1A5u9mGVLQPvafmRdumWJuOnQ9X09UcRhdgr4)
Execution 2 (does not read from cache):
[Image](https://private-user-images.githubusercontent.com/35151789/461165556-ff0e1613-f05b-4e7e-8579-8b631cd0fd4c.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTEzOTA4MzIsIm5iZiI6MTc1MTM5MDUzMiwicGF0aCI6Ii8zNTE1MTc4OS80NjExNjU1NTYtZmYwZTE2MTMtZjA1Yi00ZTdlLTg1NzktOGI2MzFjZDBmZDRjLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA3MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNzAxVDE3MjIxMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTExMzZjYzE0ZjJiZTRkNWM0MWUzMThiNzc4NTIzZWExYzlkYmY0MDM3MDhlZTFhNmRjNjJkZDUxMzExYTA0MTAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.gP-fHrld1NFGz7PvtfNIPlJLYbLCG04JMirt7Ikt2P8)
Execution 3 (reads from cache):
[Image](https://private-user-images.githubusercontent.com/35151789/461165736-dfc8fd4d-c9f4-4ecf-935c-b9d449afc13d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTEzOTA4MzIsIm5iZiI6MTc1MTM5MDUzMiwicGF0aCI6Ii8zNTE1MTc4OS80NjExNjU3MzYtZGZjOGZkNGQtYzlmNC00ZWNmLTkzNWMtYjlkNDQ5YWZjMTNkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA3MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNzAxVDE3MjIxMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTY2YjExNDg3YzVlZTMyZWRmYjIyYmI0ZjQxOWM2NDNiYjk0ZjY5YjEyMWYxN2NmZmJjNjE4MzYyOTBlNzU3MDAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.td--kkbicd1Tue6OPrixwgd6Pp8Guopyn736EWAP_yk)
Execution 4 (does not read from cache):
[Image](https://private-user-images.githubusercontent.com/35151789/461165979-13a1e216-8cd4-4f83-a7bf-7f3abed4f289.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NTEzOTA4MzIsIm5iZiI6MTc1MTM5MDUzMiwicGF0aCI6Ii8zNTE1MTc4OS80NjExNjU5NzktMTNhMWUyMTYtOGNkNC00ZjgzLWE3YmYtN2YzYWJlZDRmMjg5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTA3MDElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwNzAxVDE3MjIxMlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWY1ZWUwOWY0MmFlMWJiYWY2YWE2ZGI3YTVjNzliOGQ2OTc4YjU4N2U3NDBkZDIwNGU4NTdmZTZkN2ZmZmU3YTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.YoP8HHyGo0UyX0JXAux6V7RESpgztYo_rQYbTOY0AB0)
I've noticed that the keys of the input order are switching each time I run it, and if it happens to be the same as a previous execution (e.g., compare 1 and 3) it will read from cache.
### Expected behavior
Cache should get hit on every subsequent execution with identical dataclasses.
### Additional context to reproduce
Example workflow:
from dataclasses import dataclass
from flytekit import task, workflow
from mashumaro.mixins.json import DataClassJSONMixin
@dataclass
class NestedInnerSpec(DataClassJSONMixin):
"""A simple dataclass to demonstrate nested dataclasses in Flyte."""
w: int
x: int
y: int
z: int
@dataclass
class InnerSpec(DataClassJSONMixin):
a: NestedInnerSpec
b: NestedInnerSpec
@dataclass
class Spec(DataClassJSONMixin):
"""Base class for all specifications in the pipeline."""
a: InnerSpec
@task
def get_spec() -> Spec:
"""Get the default specification for the pipeline."""
return Spec(
a=InnerSpec(
a=NestedInnerSpec(w=0, x=1, y=2, z=3),
b=NestedInnerSpec(w=4, x=5, y=6, z=7),
)
)
@task(cache=True, cache_version="abc")
def task1(spec: InnerSpec) -> InnerSpec:
"""A simple task that returns the input spec."""
…
flyteorg/flyte